@@ -24,9 +24,21 @@ Just say which information you want to extract and the library will do it for yo
24
24
<img src =" https://raw.githubusercontent.com/VinciGit00/Scrapegraph-ai/main/docs/assets/sgai-hero.png " alt =" ScrapeGraphAI Hero " style =" width : 100% ;" >
25
25
</p >
26
26
27
- ## News 📰
27
+ ## 🔗 ScrapeGraph API & SDKs
28
+ If you are looking for a quick solution to integrate ScrapeGraph in your system, check out our powerful API [ here!] ( https://dashboard.scrapegraphai.com/login )
28
29
29
- - ScrapegraphAI has now his APIs! Check it out [ here] ( https://scrapegraphai.com ) !
30
+ <p align =" center " >
31
+ <img src =" https://raw.githubusercontent.com/VinciGit00/Scrapegraph-ai/main/docs/assets/api-banner.png " alt =" ScrapeGraph API Banner " style =" width : 100% ;" >
32
+ </p >
33
+
34
+ We offer SDKs in both Python and Node.js, making it easy to integrate into your projects. Check them out below:
35
+
36
+ | SDK | Language | GitHub Link |
37
+ | -----------| ----------| -----------------------------------------------------------------------------|
38
+ | Python SDK | Python | [ scrapegraph-py] ( https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-py ) |
39
+ | Node.js SDK | Node.js | [ scrapegraph-js] ( https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-js ) |
40
+
41
+ The Official API Documentation can be found [ here] ( https://docs.scrapegraphai.com/ ) .
30
42
31
43
## 🚀 Quick install
32
44
@@ -87,8 +99,8 @@ graph_config = {
87
99
88
100
# Create the SmartScraperGraph instance
89
101
smart_scraper_graph = SmartScraperGraph(
90
- prompt = " Find some information about what does the company do, the name and a contact email. " ,
91
- source = " https://scrapegraphai. com/ " ,
102
+ prompt = " Extract me all the news from the website " ,
103
+ source = " https://www.wired. com" ,
92
104
config = graph_config
93
105
)
94
106
@@ -100,10 +112,20 @@ print(json.dumps(result, indent=4))
100
112
The output will be a dictionary like the following:
101
113
102
114
``` python
103
- {
104
- " company" : " ScrapeGraphAI" ,
105
- " name" : " ScrapeGraphAI Extracting content from websites and local documents using LLM" ,
106
- " contact_email" :
" [email protected] "
115
+ " result" : {
116
+ " news" : [
117
+ {
118
+ " title" : " The New Jersey Drone Mystery May Not Actually Be That Mysterious" ,
119
+ " link" : " https://www.wired.com/story/new-jersey-drone-mystery-maybe-not-drones/" ,
120
+ " author" : " Lily Hay Newman"
121
+ },
122
+ {
123
+ " title" : " Former ByteDance Intern Accused of Sabotage Among Winners of Prestigious AI Award" ,
124
+ " link" : " https://www.wired.com/story/bytedance-intern-best-paper-neurips/" ,
125
+ " author" : " Louise Matsakis"
126
+ },
127
+ ...
128
+ ]
107
129
}
108
130
```
109
131
There are other pipelines that can be used to extract information from multiple pages, generate Python scripts, or even generate audio files.
@@ -135,8 +157,7 @@ Try it directly on the web using Google Colab:
135
157
## 📖 Documentation
136
158
137
159
The documentation for ScrapeGraphAI can be found [ here] ( https://scrapegraph-ai.readthedocs.io/en/latest/ ) .
138
-
139
- Check out also the Docusaurus [ here] ( https://scrapegraph-doc.onrender.com/ ) .
160
+ Check out also the Docusaurus [ here] ( https://docs-oss.scrapegraphai.com/ ) .
140
161
141
162
## 🏆 Sponsors
142
163
<div style =" text-align : center ;" >
@@ -204,4 +225,4 @@ ScrapeGraphAI is licensed under the MIT License. See the [LICENSE](https://githu
204
225
- We would like to thank all the contributors to the project and the open-source community for their support.
205
226
- ScrapeGraphAI is meant to be used for data exploration and research purposes only. We are not responsible for any misuse of the library.
206
227
207
- Made with ❤️ by [ ScrapeGraph AI] ( https://scrapegraphai.com )
228
+ Made with ❤️ by [ ScrapeGraph AI] ( https://scrapegraphai.com )
0 commit comments