matitos/matitos_news
1
0 Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
175 Commits 2 Branches 0 Tags
fix-critical-bugs
Commit Graph
64 Commits
Author SHA1 Message Date
Luciano Gervasoniandopencode 9323afd68f Make optional search imports lazy to avoid GitHub dependency in CI
Tests / test (pull_request) Failing after 3m29s
Details 
Wrap gnews, GoogleNews, and search_engines imports in try/except
so the module loads without those packages installed. This allows
the test suite to run on the Gitea runner without outbound GitHub
access.

Also revert requirements.txt back to the GitHub URL for the
Search-Engines-Scraper dependency.

Co-Authored-By: opencode <noreply@opencode.ai>
 2026-09-02 12:00:14 -03:00
Luciano Gervasoni 3a33697ca3 Fix critical bugs in app_urls 
- init_db.py: parameterize SQL queries to prevent SQL injection
- scheduled_tasks.json: resolve duplicate periodic task pk (4 -> 15)
- db_utils.py: use function parameter in _get_status_pattern_matching
  instead of capturing the enclosing scope variable
- url_detail.html: fix wrong field name image_urls -> images_url
- settings.py: align Celery queues (default/light/heavy) with the task
  queues and supervisord workers
- Add /task/publish_<id>/ route to fix broken publish links in templates
 2026-09-01 15:08:14 -03:00
Luciano Gervasoni cbc422df36 Notify status bot token 2025-10-16 10:38:32 +02:00
Luciano Gervasoni d8ef738d19 Notifier fix 2025-10-14 13:10:54 +02:00
Luciano Gervasoni 2f035a4222 Notifier fix 2025-10-14 12:23:05 +02:00
Luciano Gervasoni 7924857fe5 Schools NL tuples, traceback on notify err 2025-10-14 11:33:17 +02:00
Luciano Gervasoni f44b784715 Notifications, info and warning, try catch 2025-09-09 22:06:23 +02:00
Luciano Gervasoni 24510d26e2 Notifications, info and warning 2025-09-08 17:55:03 +02:00
Luciano Gervasoni ef51a96db6 Process missing kids url based on API endpoint, fix2 2025-09-08 16:20:39 +02:00
Luciano Gervasoni 079b2473f8 Process missing kids url based on API endpoint 2025-09-08 16:12:27 +02:00
Luciano Gervasoni 2ed86e31ec Workers light,default,heavy 2025-09-08 12:34:47 +02:00
Luciano Gervasoni 892fb984d1 Debug enlarge 2025-09-05 14:18:33 +02:00
Luciano Gervasoni c17f09a94f Debug enlarge 2025-09-05 14:06:10 +02:00
Luciano Gervasoni e4a325d6b4 Request timeout debugging 2025-09-05 14:00:50 +02:00
Luciano Gervasoni 2fae0a3a9d Request timeout 2025-09-05 13:52:34 +02:00
Luciano Gervasoni 35f9260b94 Debug process raw url 2025-09-05 13:45:16 +02:00
Luciano Gervasoni 883dfcd3bd URL redirect get before newspaper processing 2025-08-22 13:11:02 +02:00
Luciano Gervasoni b08ea574d9 Notify status task 2025-08-14 15:13:18 +02:00
Luciano Gervasoni 4ccff2bc02 Notify status task 2025-08-14 15:06:53 +02:00
Luciano Gervasoni 02f756d3c2 Ride missing kids exception 2025-08-14 10:59:19 +02:00
Luciano Gervasoni e3d6cf8000 Pattern matching, foxnews request with header 2025-08-13 14:12:54 +02:00
Luciano Gervasoni 54e41139bb Duckduckgo search update 2025-07-22 22:53:53 +02:00
Luciano Gervasoni cb621c9d6b Switching to django celery for workers 2025-07-17 22:29:06 +02:00
Luciano Gervasoni 50e8666162 Django tasks workers logger 2025-07-17 00:46:48 +02:00
Luciano Gervasoni b9ba0d8f3d Logger for worker 2025-07-15 16:51:22 +02:00
Luciano Gervasoni 6612a50d13 Logger fix, env sample ram 2025-07-14 23:48:34 +02:00
Luciano Gervasoni 6c88759e7b Workers ttl 2025-07-14 23:37:48 +02:00
Luciano Gervasoni 0cb68a876b Logger parent pid 2025-07-10 14:19:57 +02:00
Luciano Gervasoni fdc3263785 Django multi worker, logging pid 2025-07-10 13:08:37 +02:00
Luciano Gervasoni 4985f09e56 Filters fix 2025-07-08 18:28:43 +02:00
Luciano Gervasoni 0cf61026e8 Selenium based fetch of different sources 2025-07-08 18:18:26 +02:00
Luciano Gervasoni 522c1cb8b3 Missing kids selenium fixes 2025-07-08 09:43:40 +02:00
Luciano Gervasoni dd8e71aaa3 Missing kid verify timeout handle 2025-07-07 16:51:55 +02:00
Luciano Gervasoni 8cf2b52325 Selenium based missing kid verify url fix (2) 2025-07-07 16:34:21 +02:00
Luciano Gervasoni a8b236bac0 Selenium based missing kid verify url 2025-07-07 16:02:11 +02:00
Luciano Gervasoni 15035c108d Missing kids processing fix 2025-07-07 13:22:18 +02:00
Luciano Gervasoni 4c0dd70bc3 missing kids status code handling 2025-07-07 12:57:57 +02:00
Luciano Gervasoni d0ae91bf35 quot parser issue fx 2025-07-03 14:13:47 +02:00
Luciano Gervasoni 80f40e1a74 unquote google general search 2025-07-03 13:52:18 +02:00
Luciano Gervasoni 68b56eafea furl remove parameters on search results 2025-07-03 13:35:40 +02:00
Luciano Gervasoni e657c3bee1 Zombie processes, quot parser issue 2025-07-03 10:56:48 +02:00
Luciano Gervasoni 8b689729bf Docker and deployment to fetcher server 2025-06-27 09:14:44 +02:00
Luciano Gervasoni 03a2949b2b django tasks scheduler update, .env and docker compose towards fetcher sca 2025-06-20 00:35:48 +02:00
Luciano Gervasoni 490f01d66c Unknown instead of error for fetched urls 2025-06-19 22:43:29 +02:00
Luciano Gervasoni f59d16b3fc Publish with hidden tag, don't publish if url id already processed, typo 2025-04-24 16:53:52 +02:00
Luciano Gervasoni b3f7cb255c Publish with hidden tag, don't publish if url id already processed 2025-04-24 16:47:14 +02:00
Luciano Gervasoni b8fdcae5ec Temperature and seed LLM 2025-04-23 17:46:47 +02:00
Luciano Gervasoni cf55c586f7 Publisher fix 2025-04-23 17:34:10 +02:00
Luciano Gervasoni e5c574ba33 LLM refactor, NPU ollama based, publisher update json query to llm 2025-04-23 16:35:50 +02:00
Luciano Gervasoni 8d0697edee Publisher task 2025-04-18 16:36:14 +02:00