Files
NexQuant/requirements.txt
T
XianBW 5787a546b5 feat: get kaggle notebooks & disscussion text for RAG (#371)
* crawl notebooks & change to DS-Agent format text

* give one function in kaggle_crawler to collect kaggle knowledge texts

* fix CI

* add tool for merge .py files to one py file

* fix CI

* delete files

* changes for select function

* add nbformat

* jump crawler import test

* del test code

* CI

* change

* change

* change
2024-09-28 05:42:47 +08:00

74 lines
1.1 KiB
Plaintext

# Requirements for runtime.
pydantic-settings
typer[all]
cython
scipy
python-Levenshtein
scikit-learn
filelock
loguru-mypy
loguru
fire
fuzzywuzzy
openai
ruamel-yaml
torch
torch_geometric
tabulate # Convert pandas dataframe to markdown table to make it more readable to LLM
numpy # we use numpy as default data format. So we have to install numpy
pandas # we use pandas as default data format. So we have to install pandas
pandarallel # parallelize pandas
feedparser
matplotlib
langchain
langchain-community
tiktoken
pymupdf # Extract shotsreens from pdf
# azure identity related
azure-identity
# PDF related
pypdf
azure-core
azure-ai-formrecognizer
# TODO: dependencies for implementing factors.
# I think it is for running insteading of implementing. The dependency should be in
statsmodels
# factor implementations
tables
# CI Fix Tool
tree-sitter-python
tree-sitter
# Jupyter related
jupyter
python-dotenv
# infrastructure related.
docker
# demo related
streamlit
plotly
st-theme
# kaggle crawler
selenium
kaggle
nbformat
# tool
seaborn
setuptools-scm
# This is a temporary package installed to pass the test_import test
xgboost
lightgbm