NewStats: 3,264,023 , 8,182,313 topics. Date: Monday, 09 June 2025 at 10:36 AM 4c5w2o

6z3e3g

Will Scrape Any Data For You - Programming - Nairaland 5z4k2s

Will Scrape Any Data For You (1480 Views)

(4)

(1) Go Down)

VinCheckr: 9:16pm On Jan 18, 2024
Hello Guys,

I am looking for web scraping/automation tasks I will do to enhance my knowledge in this field. So feel free to comment on this thread if you have any site to scrape leads from or drop your .
Ntwrk: 2:30pm On Jan 19, 2024
VinCheckr:
Hello Guys,

I am looking for web scraping/automation tasks I will do to enhance my knowledge in this field. So feel free to comment on this thread if you have any site to scrape leads from or drop your .
WhatsApp me 070301SixOne207
DataMina: 7:05pm On Jan 19, 2024
Ntwrk:

WhatsApp me 070301SixOne207
If you can scrap people search site, it then means there is not site on earth you would find difficult to scrape
DataMina: 7:06pm On Jan 19, 2024
If you can scrape people search sites, there is no site you would find difficult to scrape
VinCheckr: 8:56pm On Jan 19, 2024
DataMina:
If you can scrape people search sites, there is no site you would find difficult to scrape
What do you mean by people search sites? Please give an example.
mundi111: 7:49am On Jan 20, 2024
Ok try scrap googlenews
VinCheckr: 11:05am On Jan 20, 2024
mundi111:
Ok try scrap googlenews
That is easy, what to do with the news.
mundi111: 6:57pm On Jan 20, 2024
VinCheckr:

That is easy, what to do with the news.
Visit the top 10 news links and get the news content into like a text file for each news also name each file after the news heading
DataMina: 8:02am On Jan 22, 2024
VinCheckr:

What do you mean by people search sites? Please give an example.
They are US site you have to use VPN to access. You can access people's private phone numbers and emails from there. Sites such as that always throws recapchta issues
VinCheckr: 9:32am On Jan 23, 2024
mundi111:

Visit the top 10 news links and get the news content into like a text file for each news also name each file after the news heading
Done


https://www.youtube.com/watch?v=MhrbcxxfQTM

2 Likes

VinCheckr: 9:34am On Jan 23, 2024
DataMina:

They are US site you have to use VPN to access. You can access people's private phone numbers and emails from there. Sites such as that always throws recapchta issues
There are 3rd party solutions that solves recaptchta, I can try my luck if you can give an example.
VinCheckr: 4:34am On Jan 24, 2024
I need more tasks to do.
DataMina: 9:50am On Jan 24, 2024
VinCheckr:

There are 3rd party solutions that solves recaptchta, I can try my luck if you can give an example.
Truepeople search.com . Also ensure you use clientgatevpn because it seems that's the only type of vpn that works
Robertwillson65: 10:30am On Jan 24, 2024
[b]Build a web crawler: [/b] Create a script that automatically crawls through websites, following links and extracting data from various pages. This is a great way to explore large websites and discover hidden information.
Automate data cleaning and processing: Develop scripts that can automatically clean and format scraped data, making it ready for analysis or visualization.
Build a real-time data dashboard: Combine your scraping skills with data visualization tools to create a dashboard that updates with the latest data in real-time. This could be anything from a live news feed to a stock market tracker.
VinCheckr: 11:05am On Jan 24, 2024
Robertwillson65:
[b]Build a web crawler: [/b] Create a script that automatically crawls through websites, following links and extracting data from various pages. This is a great way to explore large websites and discover hidden information.
Automate data cleaning and processing: Develop scripts that can automatically clean and format scraped data, making it ready for analysis or visualization.
Build a real-time data dashboard: Combine your scraping skills with data visualization tools to create a dashboard that updates with the latest data in real-time. This could be anything from a live news feed to a stock market tracker.

I asked for a task not a project.
VinCheckr: 11:15am On Jan 24, 2024
DataMina:

Truepeople search.com . Also ensure you use clientgatevpn because it seems that's the only type of vpn that works

Nice one.
Beautifulday: 10:15pm On Jan 24, 2024
VinCheckr:
Hello Guys,

I am looking for web scraping/automation tasks I will do to enhance my knowledge in this field. So feel free to comment on this thread if you have any site to scrape leads from or drop your .

Scrap m.forebet.com for me on US basketball. Lastest first three months.
VinCheckr: 8:39am On Jan 25, 2024
Beautifulday:


Scrap m.forebet.com for me on US basketball. Lastest first three months.

Be more specific, can't find US basketball on that site. What specific info you want to be scraped?
Beautifulday: 8:46am On Jan 25, 2024
VinCheckr:


Be more specific, can't find US basketball on that site. What specific info you want to be scraped?

NCAA is college basketball division in USA.

The name of the teams, prediction percentage, prediction scores for at least 3 months. Any other relevant info you may get.

VinCheckr: 8:48am On Jan 25, 2024
DataMina:

Truepeople search.com . Also ensure you use clientgatevpn because it seems that's the only type of vpn that works
I was able to access the truepeoplesearch website with a proxy now, kind of old interface and very easy to scrape. In my opinion the data in this site is incorrect more of auto generated junk.
Beautifulday: 11:50am On Jan 26, 2024
VinCheckr:

I was able to access the truepeoplesearch website with a proxy now, kind of old interface and very easy to scrape. In my opinion the data in this site is incorrect more of auto generated junk.

Were you able to access the one I sent you?
VinCheckr: 12:08pm On Jan 26, 2024
Beautifulday:


Were you able to access the one I sent you?
Really I tried but I didn't understand the site's navigation, not used to betting sites.

2 Likes

Beautifulday: 1:13pm On Jan 26, 2024
VinCheckr:

Really I tried but I didn't understand the site's navigation, not used to betting sites.

Ok
mundi111: 6:08am On Jan 28, 2024
VinCheckr:

Done


https://www.youtube.com/watch?v=MhrbcxxfQTM
Just ed one site I tried once can you scrap statarea.com extract the team names home/ away then the percentage of and 2.5 goals put into an excel file or csv
VinCheckr: 11:23am On Jan 28, 2024
mundi111:

Just ed one site I tried once can you scrap statarea.com extract the team names home/ away then the percentage of and 2.5 goals put into an excel file or csv

I am not into betting, I don't understand where the teams are and all those stuffs you wrote above.
mundi111: 3:11pm On Jan 28, 2024
VinCheckr:


I am not into betting, I don't understand where the teams are and all those stuffs you wrote above.
it not a betting site it a data site but built a little bit complicated it just a table
VinCheckr: 3:37pm On Jan 30, 2024
mundi111:
it not a betting site it a data site but built a little bit complicated it just a table
It is a very simple website, nothing much just that I dont understand the info you want. I did something, check if it is what you want.

mundi111: 9:27pm On Jan 30, 2024
VinCheckr:

It is a very simple website, nothing much just that I dont understand the info you want. I did something, check if it is what you want.
You did exactly what I was talking about only missing the BTS field have you thought about implementing the automation aspect of you are in chat me up on WhatsApp because I sometimes miss this update here o7o666o5222
VinCheckr: 9:55pm On Jan 30, 2024
More tasks needed
CHRISTFUCKER: 12:20pm On Jan 31, 2024
Are you on telegram??
VinCheckr: 12:26pm On Jan 31, 2024
CHRISTFUCKER:
Are you on telegram??

Yes I am on TG, you can drop your id but it will be nice to give a hint on the task here so that I know if I can do it.
CHRISTFUCKER: 12:49pm On Jan 31, 2024
VinCheckr:


Yes I am on TG, you can drop your id but it will be nice to give a hint on the task here so that I know if I can do it.


Tochi2

(1) Reply)

Port Harcourt Programmers

(Go Up)

Sections: How To . 24
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or s on Nairaland.