Functions and Iteration
wk10-d02-fun-iterations
October 29, 2026
š Start with
Everything starts from a page that links to each of the First Ministerās speeches.
The collection page
www.gov.scot/collections/first-ministers-speeches
The links to each speech are not visible text. The URLs live in the page source, so we have to pull them out.
A speech page
Each speech page has a title, an abstract, the date, the location, and then the text of the speech.
Read page for 26 Oct speech
Copy the URL from the browser, save it as url, and use read_html() to read the page source into speech_page.
Extract title
Extract date
The date comes out as a character string. We want R to know it is a date, so we convert it with dmy(), which reads day, month, year.
Extract location
Extract abstract
Extract text
The text is many paragraphs, so this time we want every match: html_elements(), plural. We store it as a list so all the paragraphs fit in one cell of our data frame.
[[1]]
[1] " Good afternoon, and thanks for joining us. I want to start with the usual daily report on the COVID statistics."
[2] "The total number of positive cases reported yesterday was 1,122."
[3] "This represents 7.1% of the total number of tests carried out. 428 of the new cases were in Greater Glasgow and Clyde, 274 in Lanarkshire, 105 in Lothian and 97 in Ayrshire and Arran. "
[4] "The remaining cases were spread across the mainland health board regions. "
[5] "The total number of confirmed cases is now 57,874."
[6] "I can also confirm that 1,152 people are in hospital ā that is an increase of 36 from yesterday"
[7] "90 people are in intensive care, which is four more than yesterday."
[8] "And I regret to say that in the last 24 hours, one further death has been registered of a patient who first tested positive over the previous 28 days. It is important though to remember that registration offices tend not to be open as normal over the weekend so the Sunday and Monday figures are often lower."
[9] "We also reported 11 deaths on Saturday, and one yesterday. So since the last briefing on Friday, 13 additional deaths have been registered. That takes the total number of deaths, under this measurement, to 2,701."
[10] "That reminds us again of how dangerous this virus can be and I want to send my condolences to everyone who has lost someone."
[11] "I am joined by the Cabinet Secretary for Health who will say a few words about the Scottish Governmentās revised testing strategy and about preparations for winter."
[12] "Firstly, I will give a brief preview of the week ahead, before updating you on one particular issue."
[13] "On Friday, the Scottish Government published our strategic framework for tackling COVID. The framework includes the proposed levels that will apply to different parts of the country, depending on the prevalence of the virus."
[14] "As you recall on Friday we published our strategic framework for tackling COVID."
[15] "That framework included the proposed levels that will apply to different parts of the country, depending on prevalence of the virus."
[16] "Over the weekend, we've discussed the framework with partners and considered further public health advice. These discussions are continuing as are discussions with local councils."
[17] "There are likely to be some clarifications to the detail of the measures we set out on Friday and so we will publish a revised version, ahead of the parliamentary debate that will take place tomorrow."
[18] " And of course we will keep the detail of the levels under ongoing review as the pandemic develops"
[19] "I will also set out more detail ahead of tomorrow's debate on the factors that will guide decisions on which levels apply to different parts of the country."
[20] "And assuming Parliament agrees the draft framework tomorrow, Ministers will decide later in the week on advice from the national incident management team, and our chief advisors and in consultation with local councils, what levels will initially apply in what parts of the country from Monday November 2."
[21] "And I would remind you that in broad terms, the current restrictions in place in the central belt are equivalent to the proposed level three. And those in the rest of the country, broadly equivalent to level two. So for many places there may be no immediate change."
[22] "For an area to come down a level, we want to see a fall in the prevalence of the virus be sustained, not just seen on one or two days."
[23] "And that I think is important and giving business stability but also in giving people confidence that we are not going to take unnecessary risks when we start to lift restrictions."
[24] "So the next few days will see some important decisions which of course will have an impact on all of us."
[25] "I think it is important for context for all of us to remember, given how tough all of this is, that these decisions are one that Scotland is facing in common with countries across these islands, across Europe, and of course, across the world. Many countries are facing having to impose or re-impose tough restrictions, especially on hospitality, as a second wave of COVID takes hold."
[26] "The purpose of adopting tough restrictions just over two weeks ago here was to try to curb the increase in COVID cases that we were seeing before the virus ran further out of control."
[27] "The daily figures I have been reporting recently as I indicated on Friday suggest that these restrictions are starting to have an effect. We do think that the increase in case numbers is slowing but it's not yet in decline, which is why we can't be complacent, but we should take encouragement from the daily numbers at the moment because they suggest that the sacrifices that everybody is making are starting to work."
[28] "Once the new five levels approach is adopted and once people get more familiar with it, which I know will take a bit of time, I hope people will be better able to understand, on an ongoing basis the spread of COVID in their particular area, and also what measures are necessary to tackle it."
[29] "Hopefully that in turn will underline a key point. The best way of moving to a lower level of restrictions ā and of living more freely ā is to have a lower level of transmission. And the best way we have of driving transmission lower ā and keeping it low ā is for all of us to stick to the rules that are in place at any given time. That is of course a collective responsibility for all of us."
[30] "The second point I want to highlight is that two more walk-through testing sites have opened in the last few days."
[31] "On Thursday, a new site opened in the centre of Greenock in Inverclyde, and on Saturday, one opened at the Highland Council headquarters in Inverness."
[32] "That means that in total we have 11 walk-through testing sites now open to meet the needs of local communities across Scotland and to try to make access to testing easier for people."
[33] "I want to take this opportunity to thank everyone involved in setting up these sites and all those who are helping to run them."
[34] "This walk-through centres are only part of our testing infrastructure but they are an important way to make testing more accessible in Scotlandās towns and cities. So we will continue to work with partners ā including the UK Government - to establish more of them in the weeks and months ahead.."
[35] "It is possible to book a test at a walk-through site by going to the NHS Inform website. Please remember that though they are walk-through sites, you should seek to walk, cycle or drive to them, but do not use public transport to travel to any testing centre."
[36] "If you do not have a car - and cannot walk or cycle - please book a home testing kit through NHS Inform."
[37] "The reason for that, is to ensure you do not transmit the virus on the way to or from the testing centre."
[38] "I would remind everybody again that if you experience an of the symptoms of COVID it is really important to self-isolate immediately and take steps to get tested."
[39] "I want to end, as usual, by stressing the other key rules and guidelines."
[40] "If you live in Lothian, Lanarkshire, Forth Valley, Ayrshire and Arran and Greater Glasgow and Clyde, you should not travel outside those areas unless you have a clear need to do so."
[41] "People living in other parts of Scotland should not travel to these areas unless necessary."
[42] "None of us should be visiting each otherās homes just now, except for very specific purposes such as childcare or looking after a vulnerable person."
[43] "And when we do meet people from other households - outdoors, or at a cafƩ - the maximum group size is 6, from a maximum of two households."
[44] "Avoid car-sharing if you can. Work from home if you can. And remember to download the Protect Scotland app, if you havenāt already done so."
[45] "And finally, remember the FACTS ā the five rules which will help to remind you how to do the right thing."
[46] "If we all stick to these rules then hopefully the encouraging signs we are seeing in the figures that we are reporting every day will not just continue but accelerate, and a slowing of the increase over the weeks to come will become a decline in the number of daily new cases."
[47] "Thank you all very much." 
Put it all in a data frame
A tibble with one row, because it is one speech, and six columns. The url is the input we started with.
Put it all in a data frame
When should you write a function?
When youāve copied and pasted a block of code more than twice.
How many copies?
In the video, a search of the collection page for ācoronavirus covid-19ā found 142 hits. That is a lot of copying and pasting.
š Start with
We have a function that scrapes one speech, given its URL. Now we need a list of URLs.
Inputs
You now have a function that will scrape the relevant info on speeches given the URL of the page of the speech. Where can we get a list of URLs of each of the speeches?
So far we have clicked on these links by hand. We want to pull the URLs hidden under the links out of the page source.
