Crunches, sessions five and six, plus other notes from the week

MONDAY 

Due to “life” I hadn’t seen Skye for two weeks when we popped down on Monday. And oh, what a change. The past few sessions, when I’d begun core stabilisers with her, she’d been thrilled about it all. Really starting to open up and engage. Moments of mutual grooming, following me to ask for more, coming a few steps when called, lots of chilled and enthusiastic vibes. 

But during the gap she seemed to have decided to be suspicious of humans again. I’ve no real idea why! She was wormed by the livery owner and I sadly couldn’t be there. I’m told this went not great but not terribly either, and I trust that the owner will have done a brilliant job. Mind you, “not great” is possibly enough, at this stage of Skye’s fragile trust in humans, to give us a small step backwards. Not a problem though. 

The session just became about engagement. Do you want to take part? Can you relax? Can you trust that this is only a normal clicker session? 

At first she was mentally stuck, which manifest itself as being physically stuck. She literally would not move those feet or take a step towards me. Lots of turning her head away (calming signals), uncertainty about targeting, lots of stressed facial expressions. 

Once she did move her feet (prompted by another horse) it was away from me. And at first I thought she looked lame! But later she was moving fine, so I think it was just the spongy grass pulling at her feet (it certainly always makes my “gait” look even worse than it is!). 

So we took things very slow, went in for a bit of clicker, moved away for a bit, back and forth like this to keep the emotional pressure low but to give her opportunities to engage. And by the end she was vastly better. Still not happy, like she had been last time I saw her, but not tense either. 

This is okay though. It’s the nature of the beast, as it were. Anyone who has been traumatised will have their moments. Progress isn’t a straight line into the heavens. And gentle, emotional progress with horses can be like watching paint dry. But so it has to be. You can’t force the issue. 

 

TUESDAY

Tax return. Urg. But then I played with some visuals for a project John might be doing (jazz) and some fashion photo editing (from when my friend Marianne and I shot corsetry in my boatyard!). No horses or fresh air today, sadly. 

 

WEDNESDAY 

Back to volunteering, which was lovely. Just the morning though, as then I hopped on the train to see Skye. 

Lovely velvety fluffy Skye is often very muddy. Which I’m thrilled about actually, it’s natural behaviour and indicates a horse comfortable getting up and down. But I’d never seen her lay down or roll. Until today. 

Ploughing my way across the field as I reached their fence I spotted her having a merry old roll. Then she spotted me. Sat looking with ears pricked for a moment, deciding what to do, then hopped up to her feet before I could get my phone out for a sneaky video. 

I was carrying a bag-for-life, which obviously I don’t normally have, so she stayed standing and watching me for a bit. After Monday this seemed vigilant but better. Not at all stressed or sore or unhappy, just cautious. I popped my bag down and got out my tripod and zoom recorder as I’d thought, since I had no helper, I would try filming our session this way. And also because it’s another new thing for her to experience (valuable) and I would like to get her comfortable with tripods and cameras and such if I can. 

She continued watching as I set it up, then turned around and walked off. That’s new. So I know she’s still feeling a bit wary, for whatever reason. I set the camera recording and walk over to begin. The video clips are so cute, she looks over at the weird tripod again and again. The other ponies do too, but they’re far less shocked than Skye is. Some of them are positively bolshy and I do wonder at one point if my camera is going to be eaten. But no, it survives, it doesn’t even get pushed over onto the wet ground. 

I was a bad trainer this day as I had no real plan. Well, I suppose the plan (aside from introducing the tripod/camera) was to just see how she felt. Offer her different activities and see if she would happily engage in any of them. 

So we did a bit of targeting, a bit of peek-a-boo, three very short crunches sessions, and some general stroking. All with gaps in-between to give her time to think and lots of options about whether to be involved. 

Her trust in me (in humans) is a fragile thing at this stage. It had begun flourishing when we started the crunches a few weeks ago. But it isn’t yet resilient enough to suffer aversive events easily, so perhaps the worming shook her a tiny bit. We need a bigger balance in the “trust account”. Can’t press upon horses’ good natures by only make withdrawals… We have to give them cause to trust us. And no-one more so, it seems, than Skye. 

Anyway, observations from today. 

Skye was mostly looking at the tripod. But as soon as I picked up my phone to take a snap, she turned her attention/ears onto me. So I didn’t get the ears-pricked view I was expecting, haha.

The distraction of the tripod meant she wasn’t super-focused. We also had nosey ponies to contend with (nosier than normal). But even so, she did great. Looking back on the video she was actually quite interested. It just felt like a step backwards in comparison to how very enthusiastically engaged she was three weeks back. 

With peek-a-boo, I missed a few clickable moments and didn’t give her quite enough time to make the decision herself (to put her head/eyes under the tea-towel). The video makes it seem as though if I’d paused a moment longer and been more still, she’d have been more willing to do the task. I need to give her time to come to me, rather than trying to meet her halfway. 

I think crunches are now her favourite thing, instead of targeting! I’d begun to think this before. A couple of times (today and other days), a curious bit of communication has gone like so… We do some crunches. I step to the front and pull back a bit, to give her a breather if she should want. Mostly, at this stage, to be sure that she is still interested in trying them. And on those occasions, she has sometimes paused, nosed me, looked all the way around to the side I was stood on (so that her nose almost touches her own hip), and nodded her head once in that direction before turning around to look at me again. She’s not biting or nudging at her belly, it doesn’t seem to be an indicator of discomfort. So I am finding it very curious. I don’t want to anthropomorphise or otherwise mis-read the behaviour. But it’s almost like a, “hooman, get back there please, more crunches to do.” 

Question: has their been any studies done on whether horses (or other non-human animals) will nod at something as a quadruped version of pointing? 

I’m sure I’ve read a study where animals will look pointedly between the person and the thing that they’re trying to get the person to pay attention to. And if we saw that with our dogs we’d not be surprised. Even so, I’d like to know or see a little more before I interpret it that way. Except to say, for now, that this little pointed head nod has never occurred in any other circumstance and crunches seem, for now, to be the time when she’s most interested in clicker. 

Perhaps because it feels good? Perhaps because it’s an autonomous movement? Perhaps because she is making a small effort right now and it’s easier than targeting? No, that can’t be it. And it can’t be because she prefers me at her side than her head as, before crunches, she really didn’t. Hmm, they’re such interesting beasties. 

What a cute surprised face. This is as close as she got the to tripod/camera.

So, targeting, crunches, peek-a-boo, general chilling, scratching the other ponies… Oh yes, consent cues. 

Perhaps unnecessary for the majority of well-socialised un-traumatised animals, consent cues are, even so, being used more and more in the general husbandry of various beasties. And when you do have an upset animal who doesn’t trust what humans might do to her, they definitely seem worth a shot. 

You know if you approach a horse for grooming or mounting or whatever, and you give a soft hello and a polite little shoulder rub before you start? It’s kind of just a formalised version of that. You set up a sequence. This thing is always followed by that thing. So for Skye I’ve been slowly trying to add it into the way I talk with her, like this… 

I hold out my closed fist. She bumps it with her nose. I touch her for a stroke or a scratch. I then move my hand away and re-present the fist. In short, *she cues you*. After two or three repetitions she understands the sequence. “Touching the human’s fist means she’ll touch me.” And it’s fascinating seeing her figure this out. Because then once she’s got it in her head she will be choosy about whether to touch your fist or not. When she doesn’t I can say, “okey doke, I can see it makes you uncomfortable right now, I’ll move away.” And she’ll then either graze in a relieved way or mull it over before deciding to engage with you again. 

Very interesting though. If I think back, we’ve had three notable moments since meeting where she actively/obviously enjoyed being touched by me. I think almost every other moment has been either neutral or mildly aversive. So the counter-conditioning continues. 

Another interesting moment from Wednesday was that whilst herd-watching I saw Skye do a poo which Spot immediately decided to “mark”! Oh dear, he is rather obsessed with her, thinks he’s a damn stallion. Marched over very purposefully and did a poo right on top of hers. 

Despite being a bit plump, she’s still less “upside down” in her posture than she used to be, so I’m taking that as a success. Her resting neck/head height seems lower than it used to be too, as though her topline has released a bit.

As it stands, this unrequited romance may come to a momentary end anyhow, as I’ve asked the livery owner to try Skye in the “skinny” fields with some of her horses. This winter has not been cold enough, they’ve loads of food there (which is great, and the variety is very important, I’d be far more alarmed if she was fat on clover), and she’s just not gotten any slimmer. Huge grass belly. And we’re not doing much exercise right now. So fingers crossed she’ll be welcomed into the other group and will shed a few inches before spring. 

 

THURSDAY 

Volunteering again, naturally. A colder day with a biting wind. But merry enough. 

Diego was a curious case on this day. I’d not seen him for two weeks and you never know what you’ll get after a gap with horses. He was very conflicted about coming in from the field. Very concerned about having a lead rope clipped on or having your hand go near his face. Flinchy and toothy again. Even worried about having you stand at his left shoulder. Unfortunately he seems to be generalising that people with lead-ropes = bad times. Which is curious. I’ve never had a problem leading this horse so what’s going on? 

I didn’t go see Skye afterwards sadly as I ended up with a lot of stuff to carry! 

The girls have some rugs (from their own ponies) that I’m going to repair and those things are heavy. I did some sewing whilst on the yard too though. Our saddle-fitter had recently advised front risers for a couple of the ponies who don’t have much in the way of topline behind the shoulder. But money is tight. So she then said, “well if anyone can sew make some pads or something out of gamgee.” So that’s what I’ve done. 

Less to alter the balance, and more to just cushion out the area behind the scapula, where a couple of the horses are lacking muscle.

Found some damaged old bits of gamgee and a damaged but thick numnah and got to work making a front riser for one of our newest residents, Lady. The way I’ve done it is to add pockets to the front with thick pads that can be inserted. Without the pads, you would have about 5-10mm cushioning once under saddle (slightly more to the front than back). With the pads, you would have about 10-20mm cushioning at the front end, behind the scapula, in that empty space where muscle needs a chance to grow. But muscle can’t grow if it’s compressed firmly by a saddle and a rider. Who knows if this will help, but fingers crossed, and since the saddle-fitter advised it it’s definitely worth a try. 

I’ve also brought home the scraps to try to make a second pad-with-pockets (for whoever may need it), and some extra pads. I’m hoping I’ll have enough to make a couple of shapes/sizes, so that the stables can mix-and-match as per the horses’ requirements. Bloody hard work sewing in the cold though, I always hate that. Got through many cups of tea in a bid to keep myself and my hands warm but then of course that just meant that I needed a wee, haha. I was speed-stitching 20mins before closing in an effort to get this first pad finished so that they can use it, whilst crossing my legs and powering through! The glamorous stitching life of a corsetmaker. 

So my bags were quite heavy coming home. Nearly pulled my arms out. 

 

FRIDAY 

I’ve borrowed a book about how horses learn, it’s over ten years old now. I’ve only flicked through so far and, as with most things, there’s stuff to take and stuff that is outdated or unintentionally misleading. Which isn’t a criticism of the author at all (she’s massively educated and this is a wonderful book written for regular horse-owners), it’s just that time moves on and using older elements of horse-world language can be problematic. 

There were some references to “bossy” horses, that a horse following behind is driving you, which puts them higher up the hierarchy. Let’s repeat it kids, normal horse behaviour does not (as a rule) give this sort of bullying behaviour. Happy horses follow each other sweetly. The studies have been updated. Actual feral and wild horses have been monitored. Attention has been paid to their affiliative actions, not just their dominant ones. Happy herds don’t have linear, fixed, clear hierarchies. “Bossy” horses and hierarchies may well exist in domestic horses and so it is worth being aware of… but only, I feel, if taught with the caveat that hierarchies come from the stresses of domestication. Instead of presenting bossiness/dominance/bullying behaviour as a normal part of horse society. And I’m sure the author deals with management-caused behaviour issues all the time, so she’ll know how to minimise these things. 

There are also many instances of calling horses “naughty”. I’m not saying animals can’t be naughty or cheeky or whatever. But it’s a problematic label. It doesn’t describe what’s actually happening. It let’s us very easily brush things off as naughtiness. It stops us from looking for other explanations. And if a “naughty” pony suddenly becomes “naughtier”, it’s far too easy for us to consider it nothing more than a new expression of their personality. It’s not that these words are always wrong, it’s that they give us too easy a way to excuse or disregard what animals are trying to tell us with their behaviour. 

Very interestingly though, her website refers to “learned misbehaviour, or ‘naughtiness'” (my emphasis). Learned misbehaviour strikes me as a far more useful term. It’s let’s us search for potential contributing factors to poor behaviour (which is no less a courtesy than we would offer troubled people!) rather than attribute the animal with some sort of innate quality of goodness or badness. We’re none of us born evil. People are updating their knowledge and language all the time, which is such a positive thing. 

Another blip was in using the word “reward” to mean “reinforcing”. A reward, technically, is something pleasant, something desirable, normally something added to the situation. Behaviour can be reinforced by both relief and reward. Sometimes it might be hard to distinguish which is happening. But we need to be aware that they aren’t the same thing else you get into this old notion of “the release is the reward” which can cover a multitude of sins. +R and -R aren’t the same thing and only one of them can be escalated into inadvertent punishment/violence. If we push an animal with pressure and it isn’t working… then we escalate the pressure… and we alarm or upset or hurt the animal… when they finally get it “right” and we release the pressure what they’re experiencing is not a reward. It is relief. And I’m not saying that’s always the worst thing in the world. We can all learn very effectively through -R (removal-reinforcement). But I do think we need to be aware of this. We can’t call things “rewards” if what the learner is experiencing is relief from unpleasant experiences/feelings. 

But I’m looking forward to reading more as it seems an overall good and knowledgable book. I’m only noting these things for my own learning/revision, to continue getting a handle on the topic. 

I’m especially enjoying her little anecdotes! So many instances of owners describing a behavioural/training problem which isn’t a problem at all, just a question of management or environment. My current fave was about a shorter gentleman who was towered over by his 17hh horse. He reported the horse being difficult to bridle, lifting its head away from him all the time. What it actually was, was that the man was slow to get the bridle on. So the horse would be dutifully and politely holding its head low down (which requires muscular effort), and eventually get tired and let its head drift back to neutral. Meanwhile, your man hadn’t yet managed to get the bridle on and his horse’s neutral head-carriage was “high” to him. The horse wasn’t being bad at all, the owner just wasn’t practiced at bridling and hadn’t accounted for the height difference making things tough for the horse. Solution? A mounting block. 

What a cracking little story. But it seems so common. Horses are so obliging that when they suddenly aren’t we too often blame them for it before looking to the environment (or ourselves) for the true cause. Reading between the lines, the behaviourists I respect seem to be spending most of their time pointing out factors like that rather than training issues. If we could all cultivate just a bit more empathy and imagination I’m sure we’d side-step many issues before they even occurred. Antecedent arrangements, essentially. 

She does also state unequivocally (as basically all qualified animal behaviourists do) that punishment is never advised. Too many risks, too much fall-out, too easy to get wrong, not a valid training method. A last-resort, for emergencies only. 

It’s curious that horse world is so far behind all the other realms of animal (and human) behaviour and psychology. 

 

Learning Theory, revision

I sometimes tie myself in knots trying to pick apart operant and classical conditioning. But it transpires this isn’t only a newbie question, it’s actually something behaviourists ponder over a lot. So that put my mind at ease a touch, haha. 

I thought I would do a post revising what I’ve learned. Or some of it, at least. This will be a wall of text… And of course, in a case it’s not already clear(!), I’m just learning all this stuff. For proper advice seek out a science-based equine behaviourist. 

 

 

A, B, C. 

Antecedent – Behaviour – Consequence 

Antecedent is a big, odd, word. But I guess we can just think of it as a “prompt” or “cue”, either environmental or man-made. 

The Behaviour is what follows. The Consequence determines whether the behaviour is likely to happen, in that particular circumstance, again. 

An environmental example… It rains at an angle (antecedent/prompt). Horse puts itself at a tall hedge (behaviour). Horse avoids the worst of the weather (consequence). The horse has found relief and is likely to do so again in the future, all things being equal. This would be an environmental type of negative reinforcement (-R), more on that later. If the horse doesn’t get relief from the rain, it has no reason to choose standing at the hedge in the future. 

Riding example… Rider puts their leg on lightly (cue). Horse moves forward (behaviour). Rider removes pressure (consequence). This would be a man-made type of -R. If the horse doesn’t get relief from the pressure, it has no reason to be “off the leg” in future. 

Antecedent Arrangements are ways of altering the environment or prompt or cue so as to swerve the behaviour happening at all. Horse kicks stable door when waiting for food at mealtimes. If the horse isn’t in his stable when food is being prepared, he won’t be there to kick it in frustration. Swerve. 

 

APPETITIVE/AVERSIVE 

Appetitive = desirable/pleasant. Aversive = undesirable/unpleasant. 

Food is appetitive to all horses. Pain is aversive to all horses. But circumstance means a lot. A worried animal might stop accepting food. A dog that wants you to throw his ball might no longer seem to care about treats. Pain is unpleasant, but self-harm can be somehow addictive and releasing to traumatised individuals. Overall, food, touch, freedom, and choice are appetitive whilst pain, discomfort, fear, and lack of choice are aversive. 

But experiences are appetitive or aversive to the individual learner. We each decide what matters to us. 

Blackberries and thistleheads are appetitive to my horse Skye, but they mean nothing to my friend’s pony Basil. My friend’s cob Monty intensely loves scratches, but Skye mostly only tolerates human touch at this stage and is sometimes uncertain of it. Some horses don’t mind a pat, but for others its a worryingly violent thing. 

We might judge ourselves as being nice or nasty, but it isn’t up to us. What does the learner think of it? 

Is the appetitive we have chosen appropriate? We can’t use scratches as a positive reinforcement unless a scratch is something the animal would actively seek out or “work for”. 

Is the aversive we are using affective and ethical? Is it as light as possible and does the animal understand how to behave to get it to stop? Eg: does if truly understand how to respond to rider aids? 

If we’re thinking about external motivation, appetitives and aversives are going to motivate the learner for very different reasons. 

 

APPETITIVE REINFORCERS 

Primary reinforcers are things which hold intrinsic value to the individual. Food, care, and play are the most obvious examples. Food, in particular, is hugely powerful as a reinforcer for horses because so much of their life is devoted to it. Grazing, browsing. 

Secondary reinforcers are things which come to hold appetitive value due to their association with primary reinforcers, through Classical Conditioning. 

 

CLASSICAL CONDITIONING

The pairing of a neutral stimulus with a meaningful one. Pavlov’s dogs! It can also be called Respondent Conditioning. 

In clicker training, the most obvious example is that the click (which at first meant nothing) is now a predictor of food. 

But as Shawna Karresch at Connection Training says in nearly all her videos, “the classical conditioning never stops.” You, the handler, may have begun neutral (assuming the horse doesn’t already find people aversive due to prior experience). If you are frequently paired with something pleasant/appetitive, you will take on some of that meaning. If you are frequently paired with something unpleasant/aversive, you will take on some of that meaning. How would we rather our animals, friends, and family members think of us? As a predictor of pleasant or unpleasant feelings? 

 

COUNTER CONDITIONING 

The pairing of an aversive stimulus with an appetitive one, in teeny-tiny steps, to change the associations the animal has about it. Eg: horse is afraid of clippers. You find the point at which clippers are tolerated (maybe its on the other side of the yard, just in sight, smelling of oil, but not turned on), and provide something appetitive (generally food) at the same time. The next day you repeat, maybe bringing the clippers a tiny step closer. Maybe you have to break down the various scary aspects of the clippers (the smell, the sound, the feeling of vibration) over many many many sessions. You are stretching the comfort zone very very slowly. So slowly, the animal doesn’t even perceive it happening. Soon clippers = good things. They’ve been counter-conditioned. 

 

SYSTEMATIC DESENSITISATION 

Essentially as above, except without the starting point of something already aversive that needs its meaning changed. Letting the learner slowly discover, at their own pace, that new things are fine. During desensitisation they don’t need to”earn” their food like during clicker training. And they aren’t presented directly with the scary thing if it takes them over threshold (ie: if they show any signs of alarm). 

 

FLOODING 

Flooding is deeply problematic. A flag on a stick is the classic one. You chase or worry the animal with the flag (in an enclosed space or on the end of a lead) until it stops bothering to shy away from the flag. At that point, you take the flag (the pressure) away. Or some people don’t, they just carry on rubbing it all over the body. In the latter example, in particular, the animal has learned that it cannot avoid or escape the aversive thing. Flight hasn’t worked, telling you how it feels hasn’t worked, so it stops doing anything at all. The animal is now “quiet”. This is called Learned Helplessness and it looks like a safe horse. But suppressing fear isn’t the same thing as getting over fear. Suppressed behaviours/feelings reoccur at times of stress. Not safe. 

 

OPERANT CONDITIONING 

Classical Conditioning is about learning that X = Y. Operant Conditioning is about learning that your actions have a consequence. That you can “operate” within the environment. 

Operant Conditioning is concerned with consequences that have a feedback/influence on behaviour. Because sometimes, I guess, our behaviour has no real consequence at all and so we don’t learn anything from the experience. I’m ignoring habits and stereotypies, in this post, which are self-reinforcing, as I don’t know enough about it yet. 

Consequences can be good or bad. 

The Operant Conditioning Quadrant is made up of scenarios that can be either Reinforced or Punished. 

Reinforced behaviours are those which persist or grow. 

Punished behaviours are those which cease as a result of the punishment. Behaviours can also cease as a result of having no real consequence (this is called Extinction), which is the more effective way of getting rid of “bad” behaviours. 

Reinforcers and Punishers are either added or removed to the situation. 

In operant conditioning, Positive just means added and Negative just means removed. Positive does not mean “good” and negative does not mean “bad”. 

 

POSITIVE REINFORCEMENT: The addition of an appetitive (something desirable) which makes the behaviour more likely to happen again.  NEGATIVE REINFORCEMENT: The removal of an aversive (something undesirable) which makes the behaviour more likely to happen again. 
POSITIVE PUNISHMENT: The addition of an aversive (something undesirable) which makes the behaviour less likely to happen again.  NEGATIVE PUNISHMENT: The removal of an appetitive (something desirable) which makes the behaviour less likely to happen again.  

 

If the behaviour increases, it is being reinforced. If the behaviour decreases it is either being effectively punished or having no consequence which makes it worth continuing with (Extinction). 

In more detail… 

 

POSITIVE REINFORCEMENT (+R) 

  • The addition of an appetitive (something desirable) which makes the behaviour more likely to happen again. 
  • Extrinsic motivation to works towards gaining something. 
  • Activates the SEEKING and CARE systems of the brain. These, along with PLAY, are the most useful systems to activate for effective learning and safe behaviour. 
  • Releases dopamine. 
  • As the “game” is understood, dopamine spikes shift from the receipt of the appetitive (normally food) to the moment where a task is cued. Ie: the learner enjoys figuring stuff out and gains confidence from knowing s/he can have an impact on their environment. 
  • Desired behaviour increases and is reliable. 
  • Horse offers more effort/ideas. 
  • A reward isn’t automatically a reinforcer. It is only technically a reinforcer if the target behaviour increases or sustains as desired. 

 

  • Environmental example: horse walks over a sapling. Discovers it’s the right height to have a nice scratch of the inner thigh. Horse seeks out low trees and branches in the future, to enjoy a scratch. 
  • Training example: super-early clicker training to teach manners around food. Handler stands at horse’s shoulder. Horse nudges and muzzles handler (the smell of food!). Handler ignores and stays safe. Horse gets bored, sighs, and swings its head away from handler. Handler clicks and treats. Horse quickly learns that when the handler says “stand” (prompt/cue), standing with eyes front (behaviour), will get a click and a treat (consequence). The “mugging” fades through a process of Extinction, as it serves no purpose. The behaviour of standing quietly in the presence of food increases. Due to Classical Conditioning, the horse perhaps now considers the following things appetitive: humans, particular humans, certain clothes/tools/tack (and this is one way of teaching animals when clicker is available and when it isn’t… it’s called Sign Tracking), certain smells, human voices, human laughter/giggling, human touch, the places where it happens (eg: arenas), maybe the time of day if you have a routine, and a dozen other things I can’t think of right now. 
  • Where it goes wrong: we can create conditions where the animal is reinforced even if we think it isn’t. If a behaviour persists or grows, something is reinforcing it (excepting things affected by health, pain, etc.). Eg: the animal is bored and wants attention or something to do. We tell it off for the behaviour. The animal repeats the behaviour more and more. Our “punishment” is, in this instance, actually a reinforcer. In a clicker context, poor timing or poor choices can result in us reinforcing problematic behaviours. For example, one might want to be careful to balance calm behaviours with energetic ones, if working with a pony that has to function with many handlers, children, etc. It wouldn’t be fair to teach an animal like that to always give 100% energy as in a different context this would be deemed dangerous and would be punished. So +R goes wrong when people are either unaware of the reinforcement the animal is getting, or when they don’t care to improve their timing/knowledge. But overall, the odd ill-timed click isn’t going to be a problem. 

 

NEGATIVE REINFORCEMENT (-R) 

  • The removal of an aversive (something undesirable) which makes the behaviour more likely to happen again. 
  • Extrinsic motivation to work towards avoiding something. 
  • Possibly activates the SEEKING system if done as very light pressure/release on an animal with no prior unhappy associations? [This is now me thinking aloud, not something I’ve yet learned or figured out through study.] 
  • The animal works for release of pressure. Relief does not equal reward. A reward is technically something added, not something taken away. 
  • Behaviour increases and is reliable. 
  • Horse offers as much effort/thought as is needed. 

 

  • Environmental example: horse A is at a pile of hay. Horse B resource guards food and comes towards horse A pulling a face with a threatening posture. Horse B responds to the aversive pressure (body language) by leaving the pile of hay to find another one. Horse A has found relief from the situation. 
  • Training example: we put our leg on lightly and the horse moves forward. We instantly take our leg off, regardless of whether the horse is “forward enough” at this stage to signal that, “yes, moving away from the leg is the right answer!” This is why transitions are so much more valuable than just keeping going once moving. 
  • Where it goes wrong: if the aversive (normally some form of physical pressure) increases (escalates) further and further with no release the horse has no incentive to do the behaviour or to figure out what behaviour will work to make the pressure stop. If responding to one aversive conflicts with another, the horse has no good choice available to it. Eg: trying to get a horse forward off the leg when its prior experiences of forwardness are a yank in the gob or a fearful, punishing rider. 

 

POSITIVE PUNISHMENT (+P) 

  • The addition of an aversive (something undesirable) which makes the behaviour less likely to happen again. 
  • Horse motivated to escape or avoid the punishment happening again. 
  • Activates the FEAR and possibly RAGE systems in the brain.
  • Due to the learner being in a fearful or angry state of mind, lessons are over-learned and generalised in ways we can’t control.
  • The behaviour stops and doesn’t return, in that one particular context in which it was punished. 

 

  • Environmental example: horse touches electric fence and receives a shock/fright. Horse avoids electric fences in the future. Doesn’t always work, as everyone will know! 
  • Training example: you have an “aggressive” horse in cross-ties on the yard. Each time it puts its ears back you spray its face with water. Horse learns that to avoid the annoying spray it shouldn’t express its feelings with its ears. 
  • Where it goes wrong: risk of poor judgement, generalisation by animal, and an inability to learn whilst afraid/angry. In the above example, the horse doesn’t stop feeling angry, he’s just stopped showing it. Which is far more dangerous. He’s also learned that hoses/water around the face aren’t nice (unhelpful if you ever want to bathe your horse). And perhaps his *reason* for the aggression is something easily fixed or avoided in the first place. Another example: horse is being led in from the field. Gets a fright from behind, but the handler is unaware. Horse runs forward and into the handler (safety in numbers). Handler yanks on a chifney bit, growls and shouts, smacks horse around head with the lead or reins. Horse is now worried not only of the thing which scared her from behind, but also of the human that she thought she could trust. Due to Classical Conditioning, horse perhaps now considers the following things aversive: humans (possibly even a specific, colour, height, or gender), distinctive items of clothing that human wore, associated smells, chifney bits, possibly all bridles, possibly therefore any feeling of “contact” on the reins, being lead from the field, seeing a human coming to lead her from the field, various other things I can’t even think of… And of course, whatever it was that frightened her in the first place. Punishment has to be lightning fast if the horse is going to have any chance of knowing what exact behaviour is being punished. It has to be so fast that the handler won’t actually have time to assess whether it’s appropriate. It has to be scary/horrible enough that the horse won’t repeat the unwanted behaviour and end up in a cycle of continued punishment (as then punishment may just stop working entirely). But not so scary/horrible that it causes generalised fear or anger. It has to be done when the animal is in a thinking frame of mind (not when their FEAR, PANIC, LUST, or RAGE systems are engaged), else they won’t learn the right lesson. We should avoid punishing behaviours that we could have swerved or faded in the first place. We have to be 100% confident that the behaviour isn’t a fair communication on the part of the horse (eg: pain or fear). And the punishment has to work. It has to stop the unwanted behaviour, otherwise it’s just aggression. That’s a lot of hoops to jump through. 

 

NEGATIVE PUNISHMENT (-P) 

  • The removal of an appetitive (something desirable) which makes the behaviour less likely to happen again.
  • Horse learns that behaviour X results in the loss of Z. 
  • Can activate the RAGE system if not careful, leading to frustration in the learner. 
  • Behaviour stops and doesn’t return (if the punishment has worked). 
 
  • Environmental example: horse A wants to play with horse B. Horse A is too rambunctious and so horse B disengages. Horse A learns to be a bit less bolshy when playing with that particular horse. This is apparently how dogs teach their puppies about acceptable bite pressure and how foals learn about acceptable play and grooming. 
  • Training example: you’re saying hello to a horse at the fence and giving him a wither scratch. Everything is nice until the horse gets too keen and nibbles at your clothes. Horse only thinks he is grooming, but you don’t want him to learn to groom humans with his teeth… So you walk away and in doing so take your pleasant scratches with you. The horse learns that using his teeth makes the nice scratches go away, so he uses only his lips in the future. 
  • Where it goes wrong: taking away something desirable can be very frustrating for the animal, especially if it is something highly desirable like their favourite food. Clicker trainers can accidentally cause this frustration. If they haven’t set up the situation quite right or are expecting too much from the animal for that particular moment, they might have to use -P to stop unwanted behaviours. Better by far to swerve that problem entirely, if possible, as frustration comes from the RAGE system and does not make for good or safe learning. 

 

SALIENCE  

Salience is about what matters most to the individual. What is most pertinent in any given situation. Perhaps I teach a dog to sit and I say the word “sit” thinking that is my cue. But the dog, being so much more on body language than me, begins sitting at the shifting of my arm as I have also been lifting my clicker hand to create the behaviour. The movement is more salient than the voice, to that dog. 

Perhaps I teach a horse to lift it’s foreleg by tap-tap-tapping with a schooling whip, but the horse isn’t quite doing what I want (maybe I want the leg higher or straighter) so I keep tapping until they finally get the right answer (-R, though not very cleverly done perhaps). The horse is pulling faces and getting annoyed and starting to think I’m not very nice. Perhaps they do something “naughty” and I use the schooling whip to smack them as punishment (+P), then carry on tapping. When they finally “get it” I remove the tapping/pressure, click, and treat (+R). Is it the click/treat or the removal of the annoying tapping and reduction of threat that is most important to that horse? Which is most salient? 

Negativity Bias has it that the unpleasant part is going to be the most “important” to the horse. And we risk “poisoning” the click/treat/ourselves or even the cue by combining quadrants. 

 

TRUST ACCOUNTS AND RESILIENCE 

As put beautifully in that quote by Max Easey the other day, relationships are classically conditioned. 

This is often also referred to as the Trust Account between any two individuals. 

We should aim to make more appetitive deposits in the account than aversive withdrawals. Ie: we’re sweet more often than we’re critical… we’re generous more often than greedy… we praise more than we chastise… 

If we keep that in mind with our animals (and, let’s be honest, our friends!), if we treat them sweetly, then on the rare and unfortunate occasions that we might need to be aversive we will (hopefully) be forgiven for it. This ability to recover is Resilience. But it has to balance out from the animal’s perspective. We need to be paying in vastly more than we’re taking out.

And with an animal that already considers humans (or the things we do) aversive, we need to take affirmative action. We need to go consciously to the side of appetitive stimulation, to bring the balance back up. To get out of the huge overdraft we’ve inherited! 

 

SUMMARY 

My head is now done for the day. In terms of classical and operant conditioning, I think these are the most pertinent points. I’ve referenced the emotional brain systems without going into detail on them as they’re already mentioned in other posts. 

Useful revision session though. Things are starting to click (ha) and slowly become second-nature now. And writing it all down let’s me see where the gaps in knowledge are. I do love learning. If only one could get paid for studying! 

Negativity Bias

I’ve spent the afternoon learning about “negativity bias” via Dr. Rick Hansen and others. It was interesting to have something we all know (I think) articulated with neuro-scientific reasoning. 

The short version is that due to our evolutionary excellence at survival, we give far more value to negative experiences than positive ones. 

All animals do. It is an adaptation that keeps us safe, when dangers are mortal and short-lived. When we can quickly return to “rest and digest” after the stressful episode the damage done by stress is negligible. Homeostasis is regained. 

It is also an adaptation, however, that doesn’t quite serve us well in modern life and whilst we can consciously work on our mind-sets other animals can’t, which is something to consider. We can also change our environment to change our mindset/behaviour, whilst most domestic animals have no say in how they’re kept. 

As an aside, Robert Sapolsky is really interesting for his work on chronic stress and behaviour. He has one talk on this topic called something like, “why zebras don’t get ulcers” which I thought was a sadly funny title as I suppose he may not be aware of the prevalence of ulcers in domestic equines. 

Anyway, Hansen described negative experiences as putting our brain into “red zone” states, as opposed to “green zone” which would be about the parasympathetic nervous system (rest and digest) or sometimes a play state (sympathetic nervous system but without any real fear of threat). To use +R language, red zone would be “over threshold.” 

We (all animals) over-learn through negative experiences. We give them too much significance. We are exceptionally good at saying, “once burned, twice shy!” If we spend too much time in that mindset (for example through the chronic low-level stresses of modern life), we begin to imagine that everything can and likely will “burn” us. And every negative experience makes us more likely to go to the red zone, so it becomes self-perpetuating. The more time spent in that survival mode, that feeling of threat, the less able we are to function calmly and rationally in day-to-day life. We establish beliefs based on extreme scenarios and threatening situations (a lack of safety, satisfaction, and connection, as relating to the three tiers of the brain), rather than based on the reality of things. We might appear in control, but actually be deeply unsettled. 

To put it personally, it’s the individual who loses their father (me) then wakes up almost twenty years later and has to pause and check that her partner (who is far fitter and healthier than herself!) is still breathing in his sleep. A fearful and unhelpful type of anxiety which comes and goes, courtesy of a brain which has been hard-wired through evolution to always be ready for bad things. 

But the really interesting part for me, is how flawed this system for learning is. 

We learn very swiftly and very profoundly through negative experience. But we don’t learn the right sodding stuff. Not with any reliability or assuredness. My father died of cancer. But I didn’t learn to take better care of my health. I learned to have a horror of loving people incase they leave. It isn’t all bad, I’ve learned many good lessons through consciously reflecting on it all, and the anxiety has lessened over time as a result. But that was the strongest, deepest, most emotional, and most lasting lesson learned, for sure. A lesson of fear. 

If even humans, with all our conscious thought and self-reflexivity, don’t learn the right lessons through negative experiences… if even we need at least five meaningful positive experiences to counteract one bad one… then the animals we cohabit with, what does it mean for them? 

I’d hazard it means that positive experiences/interactions need to far far far outweigh negative ones. Trainers call it a high reinforcement history. There’s a lot of clawing back to be done when an animal has had an unpleasant experience and the more they’ve had the longer it’s going to take to get back to relaxed and neutral. The more consistency it’s going to take. Example, Skye. We’re not going to know precisely what they’ve learned through the experience and if we’ve created the experience ourselves we likewise can’t control how it is perceived by the animal and whether the lesson we’re trying to teach is what they’ve actually filed away in the deepest, most reactive, parts of their brains. Fear, stress, and anxiety do not make for optimal learning states, after all. 

Hansen was connecting the neuroscience to notions of dharma and in doing so noted that what we need to attempt is to have thousands upon thousands of moments/experiences in which we consciously are aware of having our needs met. Of feeling safe, satisfied, and socially connected. This is how to counteract negativity bias. But since animals aren’t deliberately ruminating on their good fortune, how do we help them live mostly within this peaceful state (and thus be safe and reliable in their behaviour)? 

An exceptionally high frequency of positive experiences (as determined by the species ethology) with a commitment to, wherever possible, avoid negative experiences. Not just to be kind and fluffy, but because practically speaking a dog which has learned a default setting of fearfulness (like my mum’s Poppy, for example) through unpleasant experiences (human created in her instance, sadly) can be really difficult to manage. I watched a documentary on the challenges facing rescue shelters in the USA last night. There are a zillion problems to contend with and really it’s about culture change. Something they’ve seen grow over the past few years (since a certain aggressive “I am alpha!” TV dog trainer became popular) is the number of people giving up animals on account of behaviour problems that they’ve created/worsened through attempting to control their dogs with this kind of philosophy. They try to teach by dominating. And the animals learn, they learn very profoundly. They just don’t learn what the owners are actually trying to teach. 

Reasons to love clicker…

Reasons to love clicker (both frivolous and serious)…

  1. The horses love it. Who wouldn’t love puzzles and rewards, if sweetly and encouragingly done? 
  2. The click has become a secondary reinforcer for me! When I hear it I feel happy. It’s only associated with good things, with success and progress. If I have a few days without doing any clicker I begin to miss it. 
  3. By definition you spend your time looking for the good moments to mark. You see the glass half full, always, and the horse likewise becomes more optimistic.
  4. +R taps into the SEEKING, PLAY, and CARE systems. It avoids the FEAR, PANIC, and RAGE systems. Thus it creates a better learning environment and avoids human-created problems. 
  5. The puzzle/SEEKING aspect of it enriches the lives of domesticated horses. Makes up for the lack of variety they may have in their everyday lives. 
  6. It makes the horses more honest. They share their thoughts more. They offer movement more readily. They start using their cognitive abilities more. Whether this is a good or bad thing will depend upon your point of view! 
  7. +P people think you’re nuts and a lost cause. But when they think you’re a lost cause they tend to leave you alone, so that’s fine. 
  8. But it works. Beautifully. 
  9. Target trained horses get braver. 
  10. Humans start seeing everything as a target! Or the target as a route into all sorts of other tasks. They become more creative because they have to. Tonight my friend’s clever pony, who is brand new to clicker, was being asked to walk and halt neatly at her shoulder, to earn the click. But on the first go he also took a bit of a step out with his haunches. Soon enough he was doing a half turn-on-the-forehand at every halt as he thought this was the answer! How to explain that we just want a straight halt without going to normal methods? When doing +R you would avoid physically pushing the horse into position or otherwise confusing the issue by using -R or +P to correct him… So how to do it? Use a fence or tree or human or arena wall. Horse will halt straight because he has to, but completely devoid of force or confusion. Click, job done. 
  11. Shorter version: +R gets you thinking in terms of side effects. How to use the environment or movement to get to the thing you want, then capture the moment with a click. 
  12. Which is to say, CLARITY! The click is a super-clear bridge/marker which pinpoints exactly the behaviour you’d like to develop. How nice that must be for horses, who usually have to figure stuff out through trial and error and who will be easily demotivated from trying if the handler isn’t bang on and really consistent with their pressure/release. 
  13. Clicker horses ask for more at the end of a session. They light up when they see their targets. And they begin to work for the click more than the reward. Dopamine soon spikes when the puzzle is cued, not when the reward is given. The primary reinforcer of food is one way in, but they get emotionally invested for it’s own sake. PLAY. When you see the enthusiasm of +R horses it’s hard to imagine not having that joyful communication. 
  14. It works for all mammals! Which is to say, despite our differences, it shows us our fundamental kinship. 

 

 

 

Permissiveness

I’ve just read about a study done with dogs to see if the “extra information” of a “no” signal (just something mild like a tone that they come to learn means “that’s not the right answer”) helps them learn more effectively. 

The answer was a conclusive no. The dogs that had that extra information were less than half as successful as the ones who only received positive reinforcement. 

The article likened it to doing a puzzle. You’d fair lose heart if each incorrect option you tried was highlighted. You’d lose enthusiasm, optimism, confidence… Your SEEKING system would be switched off. And maybe in horse world that’s what people want. Animals that are slightly switched off so they don’t volunteer ideas or opinions. But it makes no sense to me. It’s harder to teach a horse not to bite than it is to teach it to focus on politely standing with eyes front. It’s easier to teach the things you do want, than things you don’t. It’s easier to use your brain to teach incompatible behaviours (horse can’t bite you if his head is elsewhere) than to punish and stop the undesired behaviour as it happens with actual long-lasting success. It’s easier to address why things are happening in the first place than to try to punish them once they do. 

People think +R is “soft” in a bad way. That it’s too permissive, that animals “get away with” things (what a troublesome phrase that is). But the truth is +P is permissive. It is permissive towards yourself. 

Humans punish through fear, annoyance, anger, anxiety… Rarely as a training method and rarely in a considered way. And, even if they did and even if it were the mildest form of “no” you could possibly imagine, it still isn’t a very effective training method, as seen in the study above. If you ever want your horse to confidently offer extended strides, to trust your hands, to take to jumping, to boldly hack out past all manner of spooky things, you’re going to want it to be confident trying stuff out. 

We’ve all gone to +P in the heat of the moment. We lose control of ourselves. We permit ourselves to behave in a less than upright fashion. And in a true emergency sure, you do whatever you have to. But how can we expect a horse to manage its emotions if we can’t do the same? +R has principles and rules, it requires focus and a level of self-discipline. Taking the moral high ground and thinking in terms of proven training methods when a 500kg animal has pulled a threatening face at you, that can require a lot of self-control. But we know, the science has proven, that effective training stays outside of the RAGE system, for both handler and animal. So don’t piss off your sodding horse! 

Don’t be rough with the girth. Don’t be grabby with lifting feet. Don’t ask for more than they can physically do with comfort and confidence, at any given moment. Don’t be walloping them for looking sideways at you. Don’t change a confident horse into one that flinches if you move your hand towards it. Don’t be reinforcing potentially dangerous behaviour (like biting) by rewarding it with attention (because let’s be clear, what you consider a punishing bop on the nose might just be the playful attention the horse wants). And don’t be creating fearful or shut down horses by over-riding all the things they’re telling you and micro-managing all their responses. 

Humans… we’re so quick to punish a horse and so slow to control our own tempers. 

We really should hold ourselves to a higher standard, and be more tolerant of the horses as they try to figure out what on earth we humans are about.