All Questions
496 questions
0
votes
0
answers
33
views
Autogen: How to get a simple csv from the search instead of using
I am trying to get data from the web. Unfortunately, I get this error. I suppose that it identifies a big file using a search and then tries to have a conversation about that entire file. Is there any ...
- 1,189
-1
votes
1
answer
55
views
How can I automatically grab this csv? [closed]
On this page they have a button called CSV. When you click on it, it downloads a CSV of all the data on the page. For the life of me, I can't track how I could access the CSV directly! I've tried ...
- 61
1
vote
1
answer
63
views
CSV file not generating in expected folder. Prints out in terminal window
import requests
import pandas as pd
import numpy as np
import os
print("Saving file to:", os.getcwd())
# Define the URL
URL = "https://web.archive.org/web/20230902185326/https://en....
- 23
0
votes
1
answer
33
views
Python web scrape - showing no data only headers
I found the original python code https://www.actowizsolutions.com/scrape-freedom-of-information-request-portals-data.php.
I started to use this for my scraping project, however it seems that when I ...
0
votes
1
answer
49
views
Storing text data from python web scrape
So I have scraped the information that I want but I don't know how to store it. So, I can manipulate it and clean it. It's one long string either I would like to store it in a csv file or a database ...
0
votes
1
answer
682
views
How to automatically download CSV file from Spotify's Global Chart?
Spotify has a daily global chart (link) that shows the top 200 songs on the platform for a certain day. There is a download button to save the data as a CSV file on each page. I would like to ...
- 1
-4
votes
1
answer
110
views
Issue creating CSV from webscraping [closed]
I want to scrape this website https://www.thesoldiersproject.org/which-exo-members-are-in-the-military/ to retrieve the member name, enlisted date, and discharge date. But after I wrote and run my ...
- 5
1
vote
0
answers
79
views
Scraping data Airbnb
I am working on a Python script using Selenium to scrape Airbnb listings from multiple pages and gather information such as the title, price, and details about each listing. The script navigates ...
- 11
0
votes
1
answer
29
views
Why isn't my scrapy pagination by brand using counter working?
Code isn't working. I'm trying to scrape multiple pages from differents brands (categories). The page that I'm using have a list of all the brands. The brands are arranged in groups, which are ...
1
vote
2
answers
111
views
How do I download a csv using python from a webpage where there is a download button?
I am trying to write a python function that downloads/gets a csv from this webpage once a month https://www.cia.gov/the-world-factbook/references/country-data-codes/
However I can only download the ...
- 41
0
votes
2
answers
41
views
Still getting an error after using encode() when trying to write into a csv file
Here's an example of the code:
import csv
file = open("countries_information.csv", 'wb')
writer = csv.writer(file)
writer.writerow(['Country Name'.encode("utf-8)])
I get the error
&...
- 33
-2
votes
1
answer
65
views
Replacing a row value in csv with a value from a scrape function
I have a script that opens two csv files. It scrapes the links in venues.csv for an id value for a beer from a webpage, then uses that id to find corresponding data from the beer.csv and then writes ...
0
votes
0
answers
52
views
web scraping a website with python shows no results
i'm new to web scraping , i'm trying to write a code to scrape a website, i tried aliexpress because it is said that it's scraper friendly , still it doesn't show any results , when i run it , i get &...
0
votes
2
answers
116
views
Extracting data from a table using selenium
I want to extract data from a table that contains pagination using selenium but I have no idea how. The code below extracts the data correctly but I need all the data in the table and it only shows me ...
- 16
0
votes
2
answers
62
views
Problem when pasting Dataframe (Panda) into CSV
first and foremost, I am sorry for my bad usage of terms as I am fairly new to programming. I have a Dataframe and want to transform it into a CSV file (did that succesfully). My problem is, that all ...
