mirror of
https://github.com/NicolasBohn/NexQuant.git
synced 2026-08-08 04:27:44 +00:00
TPTBusiness
b4674ce3a0
The previous "fix" introduced pd.read_pickle(encoding="utf-8", "/path") which is a SyntaxError (positional argument after keyword argument). pd.read_pickle() has no encoding parameter. Replace with correct # nosec B301 comment — pickle is safe here because the files are written by the Kaggle preprocessing pipeline in a sandboxed container and never sourced from user input. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Kaggle Crawler
Install chrome & chromedriver for Linux
In one folder
# install chrome
wget https://dl.google.com/linux/direct/google-chrome-stable_current_amd64.deb
sudo apt install ./google-chrome-stable_current_amd64.deb
google-chrome --version
# install chromedriver
wget https://storage.googleapis.com/chrome-for-testing-public/<chrome-version>/linux64/chromedriver-linux64.zip
unzip chromedriver-linux64.zip
cd chromedriver-linux64
sudo mv chromedriver /usr/local/bin
sudo chmod +x /usr/local/bin/chromedriver
chromedriver --version
config
- authentication:
~/.kaggle/kaggle.json - Accept Rules in competition website. (Join Competition)
notebook crawler
download_notebooks()convert_notebooks_to_text()