mirror of
https://github.com/NicolasBohn/NexQuant.git
synced 2026-08-04 18:57:44 +00:00
WinstonLiyt
44fd1563a2
* fuse all code into one commit * remove container auto * change remove method * add kaggle env start * change kaggle api * change structure * add crawler * add requirements * refeact the code * delete mistaken codes * merge docker settings and crawler * add chrome install README for crawler usage * Connect scen with Kaggle to download data * Reformat some files to pass CI. * fix some ci errors * fix a ci error * fix a ci error --------- Co-authored-by: Bowen Xian <xianbowen@outlook.com>
71 lines
1.1 KiB
Plaintext
71 lines
1.1 KiB
Plaintext
# Requirements for runtime.
|
|
pydantic-settings
|
|
typer[all]
|
|
|
|
cython
|
|
scipy
|
|
python-Levenshtein
|
|
scikit-learn
|
|
filelock
|
|
loguru-mypy
|
|
loguru
|
|
fire
|
|
fuzzywuzzy
|
|
openai
|
|
|
|
ruamel-yaml
|
|
torch
|
|
torch_geometric
|
|
tabulate # Convert pandas dataframe to markdown table to make it more readable to LLM
|
|
numpy # we use numpy as default data format. So we have to install numpy
|
|
pandas # we use pandas as default data format. So we have to install pandas
|
|
pandarallel # parallelize pandas
|
|
feedparser
|
|
matplotlib
|
|
langchain
|
|
tiktoken
|
|
pymupdf # Extract shotsreens from pdf
|
|
|
|
# azure identity related
|
|
azure.identity
|
|
|
|
# PDF related
|
|
pypdf
|
|
azure-core
|
|
azure-ai-formrecognizer
|
|
|
|
# TODO: dependencies for implementing factors.
|
|
# I think it is for running insteading of implementing. The dependency should be in
|
|
statsmodels
|
|
|
|
# PDF related
|
|
pypdf
|
|
azure-core
|
|
azure-ai-formrecognizer
|
|
|
|
# factor implementations
|
|
tables
|
|
|
|
# azure identity related
|
|
azure.identity
|
|
|
|
# CI Fix Tool
|
|
tree-sitter-python
|
|
tree-sitter
|
|
|
|
# Jupyter related
|
|
jupyter
|
|
|
|
python-dotenv
|
|
|
|
# infrastructure related.
|
|
docker
|
|
|
|
# demo related
|
|
streamlit
|
|
plotly
|
|
st-theme
|
|
|
|
# kaggle crawler
|
|
selenium
|
|
kaggle |