R code for extracting data without using CSS path

Question

R code for extracting data without using CSS path

Hey there, I'm reaching out because I'm struggling to figure out how to extract data from a webpage (""). Learning how to scrape data is my current project, and I'm specifically trying to gather contact information (Office, Fax, email) from the website mentioned. Unfortunately, I'm having difficulty identifying a specific CSS path using Selectorgadget in R, and the script I'm using looks something like this:

library(rvest)
page_name <- read_html("page html")

page_name %>%
html_node("selector gadget node") %>%
html_text()

I managed to scrape all the other data successfully, but I'm stuck on extracting the contact information. Any help or guidance would be greatly appreciated, as my head is spinning trying to figure this out. Thanks in advance!

css r web web-scraping

Answer 1

Answer №1

The solution is right in front of us. Each contact block is equipped with a .council-list list class, allowing for easy extraction of contact information. Utilize string/regex operations to isolate the specific fields.

library(rvest)
page_content <- read_html('https://nabtu.org/about-nabtu/official-directory/building-trades-local-councils-overview/')
contact_info = page_content %>%
  html_nodes('.council-list') %>%
  html_text()

# Filter out irrelevant strings
contact_info = grep(x = contact_info, 'Email|Fax|office', ignore.case = T, value = T)

# Extract relevant information 
library(stringr)
library(magrittr)
office_number = str_extract(contact_info, 'Office:[^[:alpha:]]*')
fax_number = str_extract(contact_info, 'Fax:[^[:alpha:]]*')
email_address = str_extract(contact_info, 'Email: [^ ]*')

Answer 2

The solution is right in front of us. Each contact block is equipped with a .council-list list class, allowing for easy extraction of contact information. Utilize string/regex operations to isolate the specific fields.

library(rvest)
page_content <- read_html('https://nabtu.org/about-nabtu/official-directory/building-trades-local-councils-overview/')
contact_info = page_content %>%
  html_nodes('.council-list') %>%
  html_text()

# Filter out irrelevant strings
contact_info = grep(x = contact_info, 'Email|Fax|office', ignore.case = T, value = T)

# Extract relevant information 
library(stringr)
library(magrittr)
office_number = str_extract(contact_info, 'Office:[^[:alpha:]]*')
fax_number = str_extract(contact_info, 'Fax:[^[:alpha:]]*')
email_address = str_extract(contact_info, 'Email: [^ ]*')

R code for extracting data without using CSS path

Answer №1

Similar questions

Change the appearance of text with a button click using JavaScript

Creating a custom design for a button using an external CSS file

What are some strategies for customizing the appearance of child components within a parent component?

SendFileS (Part 2): Emailing Documents as Attachments

Is there a way in R to generate a condensed data frame containing only the variables utilized in a statistical model?

Guide: Using jQueryUI's explode effect to animate an HTML element explosion

Performing addition operations with Rcpp's IntegerVectors

Difficulty encountered in aligning items within neighboring table cells vertically

Tips for avoiding stacked bars in the presence of repeating factors

Exploring ways to interact with Span elements using Selenium in Python

What is the method to reduce the gap between the label and field in Vuetify input controls?

Calculating the difference in days between two dates for any day-count basis using R

Steps for incorporating a storyline into a CSS Chart

CSS animations - transitioning opacity in and out

What is the best way to add an ellipsis to the conclusion of a paragraph using .dotdotdot?

Tips on how to change the color scheme of a webpage

What is the method for altering the text color within a disabled input field?

When interacting with elements with the "user-select: none" property, WkWebView still allows text selection

Using Bootstrap4 to merge rows into a single column or apply rowspan in Bootstrap

Challenges with text in a Bootstrap 5 responsive carousel