Files
matitos_news/app_fetcher
Luciano Gervasoni e124dbc21a Towards django RQ
2025-03-10 12:17:31 +01:00
..
2025-03-07 17:23:09 +01:00
2025-03-07 17:23:09 +01:00
2025-03-10 12:17:31 +01:00
2025-03-07 17:23:09 +01:00
2025-03-07 11:52:35 +01:00

Fetcher

conda create -n matitos_fetcher python=3.12
conda activate matitos_fetcher
conda install -c conda-forge curl
pip install ipykernel "psycopg[binary]" git+https://github.com/ranahaani/GNews.git GoogleNews duckduckgo_search newspaper4k numpy beautifulsoup4 requests feedparser pytz redis fastapi uvicorn fastapi-utils lxml[html_clean]
  • Fetcher app

    • Contains several endpoints to perform a specific fetching type task
      • For more details, check in app.py /{fetch_type}
  • Build and run

docker build -t fetch_app .
docker run --rm --name container_fetch_app fetch_app