mirror of https://github.com/NicolasBohn/NexQuant.git synced 2026-08-03 02:17:43 +00:00

Files

T

WinstonLiyt 96424bd1ff feat: Added loop code for Kaggle scene. (#211 )

* fuse all code into one commit

* remove container auto

* change remove method

* add kaggle env start

* change kaggle api

* change structure

* add crawler

* add requirements

* refeact the code

* delete mistaken codes

* merge docker settings and crawler

* add chrome install README for crawler usage

* Connect scen with Kaggle to download data

* Reformat some files to pass CI.

* fix some ci errors

* fix a ci error

* fix a ci error

---------

Co-authored-by: Bowen Xian <xianbowen@outlook.com>

2024-08-19 10:58:28 +08:00

559 B

Raw Blame History

Kaggle Crawler

Install chrome & chromedriver for Linux

In one folder

# install chrome
wget https://dl.google.com/linux/direct/google-chrome-stable_current_amd64.deb
sudo apt install ./google-chrome-stable_current_amd64.deb
google-chrome --version

# install chromedriver
wget https://storage.googleapis.com/chrome-for-testing-public/<chrome-version>/linux64/chromedriver-linux64.zip
unzip chromedriver-linux64.zip
cd chromedriver-linux64
sudo mv chromedriver /usr/local/bin
sudo chmod +x /usr/local/bin/chromedriver

chromedriver --version

559 B Raw Blame History

Kaggle Crawler

Install chrome & chromedriver for Linux

559 B

Raw Blame History