Generous Work
  • Home
  • Blog
  • Contact
  • 0
  • 0
press Enter to search Showing all results: No products found.

    What is web scraping & how would I use it?

    By Rich Peterson on July 17, 2018
    If you’ve ever had the task of copying & pasting information from a website, you’ll appreciate the benefits of using a web scraper. 
    • A web scraper is software that collects data from a website in a structured way. 
    I’ll use an example to explain:
    • You want to create a list of all the plumbers in your area so you visit a local directory website, search fro your area then copy the website URL into your web scraping tool. Within minutes, you’ll have an Excel table with the plumber name, address, phone number etc

    Is this useful for my business?

    Using a website scraping tool is useful for:
    • Collecting customer contact lists
    • Doing competitor research
    • Compiling reports from directory websites i.e. real estate, services etc
    • Downloading product information for use in research or on your own website 

    What tools should I use?

    • For a quick, single page website scrape, try https://magic.import.io
    • For the deluxe option where you schedule scraped information, try https://www.import.io/
    • For free options, check out https://www.parsehub.com/ or https://scrapinghub.com/scrapy-cloud 
    • For more tools for scraping websites and social media sites, see this article.
    Got questions? Let me know.
    import ioresearchweb scraping
    Posted in 🤔 Advice.
    Share

    Search Blog

    About

    For the past 10 years, we’ve worked with hundreds of clients and tens of thousands of students to help them get a clear picture of how to systemise their business. We’re not fans of spam, cheap mass-marketing tactics or automating your business to within an inch of it’s life. We are fans of a customer experience where humans deal with humans, skills are appreciated, personality is maintained and where clients get more value than they expected. We’re also fans of automating any process that doesn’t deliver client-facing value in a simple, easy-to-maintain way.

    In a nutshell, we provide advice, implementation support & training to small to medium, service-based businesses to help them deliver a better customer experience & a more automated workflow. Everyone on the same page, moving in the same direction with a clear picture of who does what.

    Want a streamlined business?

    Subscribe to get our latest advice, courses and project updates in your inbox.

    PreviousPlanning a website build
    NextTruths & Myths About Udemy

    Related Posts

    • July 22, 2018

      What Shopify app can I use to prefill or validate shipping addresses?

      If you’re wanting to ensure that you don’t send a parcel to the wrong address because of a typo, you can install an address validation app, available through the Shopify app store. The two top Shopify address checker apps are: Address Validator that has a generous free plan. The app will prompt customers for their …

    • May 3, 2019

      How do I integrate Thinkific into my WordPress website?

      Further details of question: I’d like to know how to integrate our free online course onto our WordPress website. We need: a landing page for the free course to link my custom domain/subdomain DNS to your school make the Thinkific page resemble our website design (we have a style guide) include a BONUS at the …

    • September 24, 2018

      Scheduling Appointments

      To decide whether to schedule appointments yourself or automate this process, you’ll need to look at whether this is a part of the business conversation where you’re adding value. Let’s look at a few factors to decide whether to do it yourself or automate. 📚 ContentsAdd Value (DIY)AutomateTips For Automating Your Scheduling Add Value (DIY) …

    • October 13, 2019

      Asana structure for my digital agency

      I’m currently on an Asana trial and would like to know how to structure of digital agency’s workflow: Client (system some clients have multiple systems which can be separated) Project/Request under client Definition Development Test/review (approve go to regression test- fail go back to Development) CI/CD release to QA Regression test QA (approve go to client …

    • 🏠 Home
    • 📱Contact
    • © 2021 Website: design, hosting, theme.
    • Home
    • Blog
    • Contact
    • Wishlist 0