Skip to content

feat!: migrate to scrapegraph-py v2 API surface#1058

Open
VinciGit00 wants to merge 1 commit intomainfrom
feat/migrate-to-scrapegraph-py-v2
Open

feat!: migrate to scrapegraph-py v2 API surface#1058
VinciGit00 wants to merge 1 commit intomainfrom
feat/migrate-to-scrapegraph-py-v2

Conversation

@VinciGit00
Copy link
Copy Markdown
Member

Summary

API mapping

v1 Method v2 Method File
smartscraper(website_url=, user_prompt=) extract(url=, prompt=) smart_scraper_graph.py, example
searchscraper(user_prompt=) search(query=) example
markdownify(website_url=) scrape(url=) example

Breaking Change

Requires scrapegraph-py>=2.0.0.

Test plan

  • Verify SmartScraperGraph with llm_model="scrapegraphai/smart-scraper" works against v2 API
  • Run example scripts against live API
  • Existing tests pass (no other code paths affected)

🤖 Generated with Claude Code

Update all SDK usage to match the new v2 API from ScrapeGraphAI/scrapegraph-py#82:
- smartscraper() → extract(url=, prompt=)
- searchscraper() → search(query=)
- markdownify() → scrape(url=)
- Bump dependency to scrapegraph-py>=2.0.0

BREAKING CHANGE: requires scrapegraph-py v2.0.0+

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Mar 31, 2026
@github-actions
Copy link
Copy Markdown

Dependency Review

The following issues were found:
  • ✅ 0 vulnerable package(s)
  • ✅ 0 package(s) with incompatible licenses
  • ✅ 0 package(s) with invalid SPDX license definitions
  • ⚠️ 5 package(s) with unknown licenses.
See the Details below.

License Issues

pyproject.toml

PackageVersionLicenseIssue Type
scrapegraph-py>= 2.0.0NullUnknown License

requirements.txt

PackageVersionLicenseIssue Type
pygments2.20.0NullUnknown License
requests2.33.1NullUnknown License

docs/requirements.txt

PackageVersionLicenseIssue Type
pygments2.20.0NullUnknown License
requests2.33.1NullUnknown License

OpenSSF Scorecard

PackageVersionScoreDetails
pip/scrapegraph-py >= 2.0.0 UnknownUnknown
pip/pygments 2.20.0 UnknownUnknown
pip/requests 2.33.1 UnknownUnknown
pip/pygments 2.20.0 UnknownUnknown
pip/requests 2.33.1 UnknownUnknown

Scanned Files

  • docs/requirements.txt
  • pyproject.toml
  • requirements.txt

@dosubot dosubot bot added dependencies Pull requests that update a dependency file enhancement New feature or request labels Mar 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file enhancement New feature or request size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant