Skip to content

Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.

License

Notifications You must be signed in to change notification settings

hermit-crab/ScrapeMate

Repository files navigation

ScrapeMate Beta GitHub Logo

Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
Available as a Chrome/Chromium and a Firefox extensions.

Quick way to interactively pick and maintain CSS/XPath selectors and their presets for external use: website testing or scraping.

Features include:

  • Element picker (from SelectorGadget).
  • List of presets ever worked on.
  • Preset JSON editor (convenient for use in conjunction with scrapy or any similar tools). Presets selective export/import.
  • Quick preview of the data currently selected.
  • Support for ::text / ::attr() css pseudo elements and has-class() xpath function.
  • Toggling JavaScript for the tab currently working on.

Planned features: nested selectors, more template testing and possibly actual extraction capabilities. See all: TODO.

Notes

  • This was first intended as a bookmarklet but due to various limitations bookmarklet mode has been dropped. You can still check out outdated but somewhat working version at this page.

Screenshots

screenshot screenshot

Build

npm install
npm run build
# this will create ./dist/extension folder
# which you can give to chrome as an unpacked extension
# or to firefox as a temporary extension in about:debugging

Icon credits to: Freepik from www.flaticon.com