Commit Graph
27 Commits
Author SHA1 Message Date
Luciano Gervasoniandopencode fa9d552873 Point Search-Engines-Scraper dependency to Gitea mirror
Tests / test (pull_request) Successful in 7m9s
The Gitea CI runner has no outbound access to github.com.
Mirror the repository on the local Gitea instance so pip install
succeeds in CI.

Co-Authored-By: opencode <noreply@opencode.ai>
2026-09-02 11:39:31 -03:00
Luciano Gervasoni d18eda2fc4 Add unit tests and Gitea CI workflow for bug fixes
Tests / test (pull_request) Failing after 3m11s
- Add fetcher/tests/ with 21 tests covering all bug fixes:
  - test_utils: get_with_protocol URL normalization (5 tests)
  - test_config: scheduled_tasks.json PK uniqueness, Celery queue
    settings (7 tests)
  - test_publish: URL routing and view for /task/publish_<id>/ (4 tests)
  - test_template_field: url_detail.html renders images_url field (2 tests)
  - test_search_postprocess: URL host filtering and param stripping (3 tests)
- Replace empty fetcher/tests.py with tests/ package
- Add .gitea/workflows/test.yml: runs on PRs and pushes to main,
  installs dependencies and runs `manage.py test fetcher.tests`
2026-09-02 09:42:07 -03:00
Luciano Gervasoni 3a33697ca3 Fix critical bugs in app_urls
- init_db.py: parameterize SQL queries to prevent SQL injection
- scheduled_tasks.json: resolve duplicate periodic task pk (4 -> 15)
- db_utils.py: use function parameter in _get_status_pattern_matching
  instead of capturing the enclosing scope variable
- url_detail.html: fix wrong field name image_urls -> images_url
- settings.py: align Celery queues (default/light/heavy) with the task
  queues and supervisord workers
- Add /task/publish_<id>/ route to fix broken publish links in templates
2026-09-01 15:08:14 -03:00
Luciano Gervasoni cbc422df36 Notify status bot token 2025-10-16 10:38:32 +02:00
Luciano Gervasoni dc784dabec Notify status schedule 2025-10-16 10:12:17 +02:00
Luciano Gervasoni d8ef738d19 Notifier fix 2025-10-14 13:10:54 +02:00
Luciano Gervasoni 2f035a4222 Notifier fix 2025-10-14 12:23:05 +02:00
Luciano Gervasoni e057568af0 Telegram bot tokens 2025-10-14 11:36:19 +02:00
Luciano Gervasoni 7924857fe5 Schools NL tuples, traceback on notify err 2025-10-14 11:33:17 +02:00
Luciano Gervasoni f44b784715 Notifications, info and warning, try catch 2025-09-09 22:06:23 +02:00
Luciano Gervasoni 24510d26e2 Notifications, info and warning 2025-09-08 17:55:03 +02:00
Luciano Gervasoni ef51a96db6 Process missing kids url based on API endpoint, fix2 2025-09-08 16:20:39 +02:00
Luciano Gervasoni 079b2473f8 Process missing kids url based on API endpoint 2025-09-08 16:12:27 +02:00
Luciano Gervasoni 1fbc5beb6e URL Logs 2025-09-08 12:45:53 +02:00
Luciano Gervasoni 7886d16264 Flower allow API handling 2025-09-08 12:44:48 +02:00
Luciano Gervasoni 2ed86e31ec Workers light,default,heavy 2025-09-08 12:34:47 +02:00
Luciano Gervasoni 892fb984d1 Debug enlarge 2025-09-05 14:18:33 +02:00
Luciano Gervasoni c17f09a94f Debug enlarge 2025-09-05 14:06:10 +02:00
Luciano Gervasoni e4a325d6b4 Request timeout debugging 2025-09-05 14:00:50 +02:00
Luciano Gervasoni 2fae0a3a9d Request timeout 2025-09-05 13:52:34 +02:00
Luciano Gervasoni 35f9260b94 Debug process raw url 2025-09-05 13:45:16 +02:00
Luciano Gervasoni b40611bd3e Flower port update 2025-09-04 09:26:44 +02:00
Luciano Gervasoni 346d7c9187 Debug workers 2025-09-04 09:04:04 +02:00
Luciano Gervasoni a21ff9c5d6 Celery scheduler DB based 2025-09-04 08:46:04 +02:00
Luciano Gervasoni 7b0d24309c Redis cache and celery, avoid overflow (3) 2025-09-03 23:20:56 +02:00
Luciano Gervasoni 334062b0ec Redis cache and celery, avoid overflow 2025-09-03 23:18:43 +02:00
Luciano Gervasoni a9074f45b5 Redis cache and celery, avoid overflow 2025-09-03 23:07:03 +02:00