We received over 750 responses to our survey on breastfeeding and healthcare experiences in the UK and our citizen scientist analysts are looking at the data as we speak. Here’s a chat we had with Dr Gavin Brookes a little earlier, where we explored how we can use Corpus Linguistics to analyse the data.
(Image “Phyllis breastfeeding” courtesy of Thomas Widmann via Flickr CC2.0)
PSG A: Evening everyone! Welcome to our chat with Gavin about analysing our data using Corpus Linguistics. Gavin will let us know a bit about how it’ll all work, we’ll let Gavin know a bit about what our aims are.
Gavin, you and I had a chat earlier about what we’re going to do with all those words… would you be able to give us a quick overview?
Okay, so the techniques we will be using to analyse the data are known as corpus linguistics. For those who didn’t catch the last chat I was involved in, corpus linguistics is a set of methods that use computers to analyse large amounts of language data.
These techniques allow us to look at the most frequent words, words which are statistically ‘characteristic’ of our data when we compare it against other language datasets, and to ultimately look at the most frequent language patterns in the data.
A good way to go, if this sounds practical and useful, would be for me to carry out the quantitative analysis myself, feedback on the most common thematic patterns in the data, and then for the group members to carry out more manual, thematic analysis on words, phrases and themes that have emerged as frequent or otherwise statistically interesting.
PSG B: Are there special software packages you use for the quantitative analysis? Is, packages we might not already have?
PSG A: There are free software packages Gavin can show us how to use.
Just to mention this would be a core group of up to 6 analysts. And that group can feed back to the wider group as a whole.
Gavin: If that sounds like a good plan, then this would require minimal (though some) technical skill on the part of group members carrying out the analysis, which I can assist with and send video tutorials for, but 90% of this is thematic analysis that basically requires you to read the comments and identify themes and recurring patterns.
The benefit of the quantitative analysis that I will carry out is that it will allow us to pinpoint words and phrases of interest and so to focus that analytical attention (rather than reading all 600 comments!).
For the thematic analysis of those messages and samples, I would also be able to provide a short sample analysis so that we all know what it looks like and should all then produce something similar in format
PSG C: sounds interesting
Gavin: The most useful thing for me personally to know at this point is any specific questions/aims or topics that you want to address, as I can explore these kinds of issues in the quantitative analysis, which can then inform the subsequent thematic analysis.
PSG A: A reminder, we’re asking people these questions:
** STORIES **
– their stories of BFing & healthcare interactions (free text – the main bit!)
– when the interactions happened
– which HCPs and BFing supporters were involved
** ABOUT THE INTERACTION WITH BIGGEST IMPACT **
– which single HCP / BFing supporter had the greatest impact BFing
– how positive or negative was that impact
– was the advice given appropriate in their opinion
– why was it appropriate / inappropriate (free text)
– whether they’d asked for BFing advice or not
– how old was the child(ren) at the time of the interaction
– did the interaction change how they fed their child
– what happened after (e.g. did they BF / FF more / less etc)
** ABOUT THEIR KIDS **
– how many children
– how old
– how long did they expect to BF each of their children
– how long did they BF each of their children?
– why did they stop BFing each child?
** DEMOGRAPHICS **
– location (by postcode)
– age they left full time education
– highest education level
– where they say survey advertised
Gavin: Okay, so for the quantitative analysis, I can divide the data according to the responses to these questions, for example to look at significant differences in the words used by people of different age groups, ethnicity, education level, number of children, etc.
PSG A: One thing the group is very much interested in also, is the responses according:
– the type of HCP
– the rating of the interaction
– the outcome of the interaction (e.g. can you see any themes among the women who stopped BFing or cut it down after the interaction)
PSG F: I want to know which professional group has the most positive impact and which group a negative impact. Whether the age of the mother and age of the child makes a difference – are younger mothers more likely to be affected by bad advice? are positive interactions more prevalent with younger babies than with older children.
And I’d like to know if we can identify consistent patterns in good/bad interactions and advice so that we could make some recommendations about who needs better training.
I’d also like to know if there are particular issues that recur – for example we already know anecdotally that maternal mental health is an area where women are often told they need to stop bf in order to take medications which is often totally false.
Oh my goodness I have so many things I want to know but i’ll stop with this one…. Can HCP advice cause women to stop bf before they wanted to?
PSG G: I think it would be interesting to look at what differs between those who stopped breastfeeding “early” (we’d have to define that!) and those who carried on. So, say, <3months versus >3months…..
PSG A: Definitely 🙂
Gavin: would that be a threshold – 3 months – along which to make comparisons?
PSG D: We’d definitely have to define early.
And combine that with stopping earlier than they wanted perhaps?
PSG A: Does anyone know the rates of BFing in the UK? Where would we get the latest figures? (Would be useful to know what the drop out rate is against time when making this decision)
PSG D: I prefer 6 months due to weaning
Gavin: It would be good to get these issues decided on before next week – as I can then organise the data according to these thresholds
PSG A: How many get to 6 months though? Do we also want to capture those who have been put off in the first couple of weeks?
Are there 2 questions here?
i.e. looking at those stopped before they’d got properly established
those who didn’t reach the 6 month mark?
We could also look at people who did / didn’t meet their goals, as we’ve asked about expected and how long they BF for in the end.
Gavin: Would the data allow us to look at cases where people stopped before they were established or wanted to – or are we relying on people explicitly stating so in the free text responses? It doesn’t make it impossible if it’s the latter but obviously limits us a bit
PSG B: Maybe six weeks and six months for thresholds? It’s in the 2010 Infant feeding survey, a shocking number don’t make it to something like six weeks given that 80% start off intending to bf. I think the numbers that make it to six months is single digit percentages (1%, 2%). It’s easy to look up.
PSG G: Definitely. Although stopping before they wanted could also be confused by returning to work worries/issues rather than HCPs advice….
PSG A: There are a couple of things here.
When I said “established” I wasn’t clear sorry! What I was getting at was a period of time (to be discussed!) at which we would assume most people have BFing established. So if women are stopping BFing in the first couple of weeks, I’m assuming they gave up as they didn’t managed to get established. Perhaps I shouldn’t use that word, as what I really mean is a time early on.
BFing can be hard to get going, particularly given the lack of support when mothers and babies hit issues. We’re all advised to BF exclusively until 6 months. In the UK, few do. But many are giving up because they’ve never really got going
Anecdotally, others are giving up around the 4 month mark as the advice used to be to wean at 4 months, the baby food is labelled “from 4 months” even though against guidelines (or at least it used to be – do they still do that?) and so people give up around them for cultural reasons.
There may be also other reasons at other times.
But my main point was, if we want to look at early weaning, we may need 2 categories for this, as there are strong arguments for both early as in a few weeks and early as in 4 months.
Gavin: Okay, that makes sense. If you can indicate to me by the time I receive the data what would be a good threshold to use, I can look at that.
Another way to approach this – or even, an additional way – would be to look at the responses and see if there is a clear dividing line (i.e. will the data tell us that the majority of people who stop do so at a particular point in time?)
PSG H: I think that may be quite telling.
PSG A: About when people wanted to, breastfeeding goals are important in breastfeeding advocacy.
One reason being, there has been an assumption that the low rates of breastfeeding in the UK could be changed by educating mothers – the implication being that mothers don’t know how good breastfeeding is.
But if you ask mothers what their goals for breastfeeding are, and when they stop, another story emerges.
Mothers aren’t reaching their own breastfeeding goals (whatever they might be – whether that be a few weeks or months or longer), so something else is happening, and it’s often to do with lack of support. Which has implications for public health – it’s not much use bashing mothers over the head with “breast is best” messages if they already know that! Especially if the issue is lack of support.
So, we’ve asked the participants, for every child – how long did they expect to breastfeed them, and how long did they in the end
Gavin: This is really interesting
PSG A: It is, isn’t it! For some background reading, check out this write up of our Q&A with Heather Tricky some time ago on breastfeeding rates:
PSG E: I think it will highlight an issues surrounding lack of knowledge of medications and breastfeeding”
Also show negative opinions around full-term feeding
PSG G: Are these 2 groups getting different advice? Do the 2 groups have different perceptions of the advice they received.
PSG I: I would be interested to know whether there was a trend in advising women to stop breastfeeding and then the development of complications such as mastitis as a result of this advice
PSG D: Oh interesting!
Tongue tie and mastitis definitely
PSG H: I’d be really interested in knowing what helped people continue breastfeeding.
PSG C: which HCP has positive impact on breastfeeding vs who they see most
PSG A: We can get a picture from the qualitative data also.
PSG J: [The qualitative data] looks interesting and maybe mirrors the findings from the 2016 WBTi report that although midwives have good basic training they are not the ones who give care in the community. The lower group from Paed down could be more knowledgeable if their curricula included the basic BFI module and practical aspects of breastfeeding which currently it doesn’t.
PSG A: Yes. I think you’re right. I haven’t done it here, but when we had about 400 results I dug a little deeper into it, and it was mostly the people who have more pre-reg training who are coming up with the highest ratings for their interactions, and those with least at the bottom (surprise surprise!! 😉 )
We’ve included the WTBi categories in the drop down so we can make these kinds of comparisons with your data.
PSG A: Gavin, for reference, the World Breastfeeding Trends Initiative. They do some amazing work. We’ve been particularly interested in their work on recording the amounts of pre-registration training that various HCPs get – see this chart.
(And prepare to be shocked how little some of them get!)
We’ve included their categories in the list of professions we ask about so we can bear in mind how much pre-reg training the different groups get when analysing & writing up
No automatic alt text available.
PSG A: Yes, it’d be interesting to see what women are being advised, irrespective of whether they acted on it.
And, whether the interaction with the greatest impact was positive or negative. (1 = most negative, 5 = most positive)
Gavin: Given that [non-UK responses] make up a relatively small proportion of the sample, I wouldn’t have thought that excluding the non-UK responses would make too much of a difference.
PSG K: I’d recommend removing non UK. Outside the UK HCP’s and peer supporters may have different kinds of training and work in a completely different healthcare system which may skew the data. If I was peer reviewing the study I’d recommend removing them!
PSG G: Gavin… what’s the smallest split we could make to still get meaningful results? Ie if we were to choose a category of respondents (‘stopped “early”’ or ‘had tongue tie’ or whatever) what’s the minimum group size we can get away with? Realise you may not be able to answer at this stage until data is looked at initially. But important to know I think to help us formulate questions…
PSG A: e.g. it’s just 34 mothers who stopped breastfeeding after the interaction
(Plus any more we get by Sunday)
Gavin: Good question. To be honest, it depends on the data. You can ‘get away’ with comparing smaller datasets, but the arguments are obviously hedged because we aren’t talking about big numbers. However, if we have evidence in the responses and consistent patterns in those responses then we can make the argument that x or y is happening, with the usual caveats.
I hope that makes sense.
PSG G: Yes. Thanks. Larger groups is always better ?
Gavin: Indeed – I’m a bit data-greedy…
PSG L: I think we’ll see a lot of GPs being supportive of bf past six months, “You’re not still feeding are you? You know there’s no benefit any more?” And also in the early days, lots of health visitors and midwives recommending bf-unfriendly practices – being anti-co-sleeping, recommending feeding intervals, jumping to suggest formula top-ups v quickly without investigating other options.
PSG J: Exactly and maybe especially from dare I say it female GPs.
Example this week.
PSG M: Is it sensible to work from the basis that BFI is positive in itself? Research shows that women aren’t always comfortable with the way that the BFI is implemented e.g., Hoddinott (2012).
Write a reply…
PSG B: Is it easy to break it down regionally? i.e., we’ve asked for the beginning of their postcode, could you do a report of stories from Reading (RG1, RG2 etc)?
Gavin: If we have the data then yes. But this might be a little fiddly so could depend on time constraints and how long it takes to do other things.
It could be a really interesting line of inquiry, though
PSG A: Is it a job we could give to a willing volunteer or two to take on perhaps?
Although – one draw back is the region is the one they currently live in, not necessarily where all the interactions took place if they’ve moved (I realised yesterday!)
Gavin: Okay this changes things I suppose
PSG D: oh good point about moving.
One thing I thought was amount of funding by councils isn’t necessarily going to correlate with feeding rates. Due to LLL and volunteer peer support programmes etc
How will categorisation of ‘good’ and ‘bad’ interactions happen given that there is no outcome data or medical history, i.e., a person might experience a HCPs advice as ‘bad’ because it wasn’t what they wanted to happen even though it may well be correct advice for the situation?
How generalisable will this data be given that we will have no idea of the response rate (high potential for non-response bias) and participants have largely been recruited as far as we can know from Facebook groups and forums with a specific interest in infant feeding?
How do you see the findings of this research being applied?
PSG G: These are good points!!
PSG B : Practicalities: after Gavin’s done some word crunching, what will he give us? Lists of word frequencies and co-locations? Maybe an example from his previous work on NHS feedback? To give us an idea of how we’ll be working together, how much work is involved our end etc.
Eg, for the qualitative interview-based project, analysts have had someone training by Skype, have been given typed interview transcripts, are coding/marking up those transcripts identifying interesting recurring things. It’s interesting but also needs a few hours of work per transcript because we’re acting as the analysts.
Gavin: In terms of what I will provide – I can provide word lists and collocations. However, I think it might be more useful for me to look at this output and interpret it to some extent to report patterns. So, I will provide a brief report on the most frequent and statistically salient patterns – including in relation to the questions you’ve put here – and then it is up to you to decide which ones are the most interesting, and then we can take it from there
In terms of actually carrying out the analysis, this requires a bit of skill but not training as such, and I will provide links to videos to show how to do this. But it mainly involves using your brain and eyes, with the help of the computer
PSG A: Thank you so much Gavin for your time, this been great, can’t wait to get going!