Luciano Gervasoni and opencode
c7104ad8f0
Filter out git+https dependencies in CI
...
Tests / test (pull_request) Successful in 7m2s
The Gitea runner can't clone github.com repos via pip.
Since the tests don't need Search-Engines-Scraper, exclude
git+ lines from requirements during CI install.
Co-Authored-By: opencode <noreply@opencode.ai >
2026-09-02 12:06:37 -03:00
Luciano Gervasoni and opencode
9323afd68f
Make optional search imports lazy to avoid GitHub dependency in CI
...
Tests / test (pull_request) Failing after 3m29s
Wrap gnews, GoogleNews, and search_engines imports in try/except
so the module loads without those packages installed. This allows
the test suite to run on the Gitea runner without outbound GitHub
access.
Also revert requirements.txt back to the GitHub URL for the
Search-Engines-Scraper dependency.
Co-Authored-By: opencode <noreply@opencode.ai >
2026-09-02 12:00:14 -03:00
Luciano Gervasoni and opencode
fa9d552873
Point Search-Engines-Scraper dependency to Gitea mirror
...
Tests / test (pull_request) Successful in 7m9s
The Gitea CI runner has no outbound access to github.com.
Mirror the repository on the local Gitea instance so pip install
succeeds in CI.
Co-Authored-By: opencode <noreply@opencode.ai >
2026-09-02 11:39:31 -03:00
Luciano Gervasoni
d18eda2fc4
Add unit tests and Gitea CI workflow for bug fixes
...
Tests / test (pull_request) Failing after 3m11s
- Add fetcher/tests/ with 21 tests covering all bug fixes:
- test_utils: get_with_protocol URL normalization (5 tests)
- test_config: scheduled_tasks.json PK uniqueness, Celery queue
settings (7 tests)
- test_publish: URL routing and view for /task/publish_<id>/ (4 tests)
- test_template_field: url_detail.html renders images_url field (2 tests)
- test_search_postprocess: URL host filtering and param stripping (3 tests)
- Replace empty fetcher/tests.py with tests/ package
- Add .gitea/workflows/test.yml: runs on PRs and pushes to main,
installs dependencies and runs `manage.py test fetcher.tests`
2026-09-02 09:42:07 -03:00
Luciano Gervasoni
3a33697ca3
Fix critical bugs in app_urls
...
- init_db.py: parameterize SQL queries to prevent SQL injection
- scheduled_tasks.json: resolve duplicate periodic task pk (4 -> 15)
- db_utils.py: use function parameter in _get_status_pattern_matching
instead of capturing the enclosing scope variable
- url_detail.html: fix wrong field name image_urls -> images_url
- settings.py: align Celery queues (default/light/heavy) with the task
queues and supervisord workers
- Add /task/publish_<id>/ route to fix broken publish links in templates
2026-09-01 15:08:14 -03:00
Luciano Gervasoni
cbc422df36
Notify status bot token
2025-10-16 10:38:32 +02:00
Luciano Gervasoni
dc784dabec
Notify status schedule
2025-10-16 10:12:17 +02:00
Luciano Gervasoni
d8ef738d19
Notifier fix
2025-10-14 13:10:54 +02:00
Luciano Gervasoni
2f035a4222
Notifier fix
2025-10-14 12:23:05 +02:00
Luciano Gervasoni
e057568af0
Telegram bot tokens
2025-10-14 11:36:19 +02:00
Luciano Gervasoni
7924857fe5
Schools NL tuples, traceback on notify err
2025-10-14 11:33:17 +02:00
Luciano Gervasoni
f44b784715
Notifications, info and warning, try catch
2025-09-09 22:06:23 +02:00
Luciano Gervasoni
24510d26e2
Notifications, info and warning
2025-09-08 17:55:03 +02:00
Luciano Gervasoni
ef51a96db6
Process missing kids url based on API endpoint, fix2
2025-09-08 16:20:39 +02:00
Luciano Gervasoni
079b2473f8
Process missing kids url based on API endpoint
2025-09-08 16:12:27 +02:00
Luciano Gervasoni
1fbc5beb6e
URL Logs
2025-09-08 12:45:53 +02:00
Luciano Gervasoni
7886d16264
Flower allow API handling
2025-09-08 12:44:48 +02:00
Luciano Gervasoni
2ed86e31ec
Workers light,default,heavy
2025-09-08 12:34:47 +02:00
Luciano Gervasoni
892fb984d1
Debug enlarge
2025-09-05 14:18:33 +02:00
Luciano Gervasoni
c17f09a94f
Debug enlarge
2025-09-05 14:06:10 +02:00
Luciano Gervasoni
e4a325d6b4
Request timeout debugging
2025-09-05 14:00:50 +02:00
Luciano Gervasoni
2fae0a3a9d
Request timeout
2025-09-05 13:52:34 +02:00
Luciano Gervasoni
35f9260b94
Debug process raw url
2025-09-05 13:45:16 +02:00
Luciano Gervasoni
b40611bd3e
Flower port update
2025-09-04 09:26:44 +02:00
Luciano Gervasoni
346d7c9187
Debug workers
2025-09-04 09:04:04 +02:00
Luciano Gervasoni
a21ff9c5d6
Celery scheduler DB based
2025-09-04 08:46:04 +02:00
Luciano Gervasoni
7b0d24309c
Redis cache and celery, avoid overflow (3)
2025-09-03 23:20:56 +02:00
Luciano Gervasoni
334062b0ec
Redis cache and celery, avoid overflow
2025-09-03 23:18:43 +02:00
Luciano Gervasoni
a9074f45b5
Redis cache and celery, avoid overflow
2025-09-03 23:07:03 +02:00
