Commit Graph

59 Commits

Author SHA1 Message Date
Luciano Gervasoni 7924857fe5 Schools NL tuples, traceback on notify err 2025-10-14 11:33:17 +02:00
Luciano Gervasoni f44b784715 Notifications, info and warning, try catch 2025-09-09 22:06:23 +02:00
Luciano Gervasoni 24510d26e2 Notifications, info and warning 2025-09-08 17:55:03 +02:00
Luciano Gervasoni ef51a96db6 Process missing kids url based on API endpoint, fix2 2025-09-08 16:20:39 +02:00
Luciano Gervasoni 079b2473f8 Process missing kids url based on API endpoint 2025-09-08 16:12:27 +02:00
Luciano Gervasoni 2ed86e31ec Workers light,default,heavy 2025-09-08 12:34:47 +02:00
Luciano Gervasoni 892fb984d1 Debug enlarge 2025-09-05 14:18:33 +02:00
Luciano Gervasoni c17f09a94f Debug enlarge 2025-09-05 14:06:10 +02:00
Luciano Gervasoni e4a325d6b4 Request timeout debugging 2025-09-05 14:00:50 +02:00
Luciano Gervasoni 2fae0a3a9d Request timeout 2025-09-05 13:52:34 +02:00
Luciano Gervasoni 35f9260b94 Debug process raw url 2025-09-05 13:45:16 +02:00
Luciano Gervasoni 883dfcd3bd URL redirect get before newspaper processing 2025-08-22 13:11:02 +02:00
Luciano Gervasoni b08ea574d9 Notify status task 2025-08-14 15:13:18 +02:00
Luciano Gervasoni 4ccff2bc02 Notify status task 2025-08-14 15:06:53 +02:00
Luciano Gervasoni 02f756d3c2 Ride missing kids exception 2025-08-14 10:59:19 +02:00
Luciano Gervasoni e3d6cf8000 Pattern matching, foxnews request with header 2025-08-13 14:12:54 +02:00
Luciano Gervasoni 54e41139bb Duckduckgo search update 2025-07-22 22:53:53 +02:00
Luciano Gervasoni cb621c9d6b Switching to django celery for workers 2025-07-17 22:29:06 +02:00
Luciano Gervasoni 50e8666162 Django tasks workers logger 2025-07-17 00:46:48 +02:00
Luciano Gervasoni b9ba0d8f3d Logger for worker 2025-07-15 16:51:22 +02:00
Luciano Gervasoni 6612a50d13 Logger fix, env sample ram 2025-07-14 23:48:34 +02:00
Luciano Gervasoni 6c88759e7b Workers ttl 2025-07-14 23:37:48 +02:00
Luciano Gervasoni 0cb68a876b Logger parent pid 2025-07-10 14:19:57 +02:00
Luciano Gervasoni fdc3263785 Django multi worker, logging pid 2025-07-10 13:08:37 +02:00
Luciano Gervasoni 4985f09e56 Filters fix 2025-07-08 18:28:43 +02:00
Luciano Gervasoni 0cf61026e8 Selenium based fetch of different sources 2025-07-08 18:18:26 +02:00
Luciano Gervasoni 522c1cb8b3 Missing kids selenium fixes 2025-07-08 09:43:40 +02:00
Luciano Gervasoni dd8e71aaa3 Missing kid verify timeout handle 2025-07-07 16:51:55 +02:00
Luciano Gervasoni 8cf2b52325 Selenium based missing kid verify url fix (2) 2025-07-07 16:34:21 +02:00
Luciano Gervasoni a8b236bac0 Selenium based missing kid verify url 2025-07-07 16:02:11 +02:00
Luciano Gervasoni 15035c108d Missing kids processing fix 2025-07-07 13:22:18 +02:00
Luciano Gervasoni 4c0dd70bc3 missing kids status code handling 2025-07-07 12:57:57 +02:00
Luciano Gervasoni d0ae91bf35 quot parser issue fx 2025-07-03 14:13:47 +02:00
Luciano Gervasoni 80f40e1a74 unquote google general search 2025-07-03 13:52:18 +02:00
Luciano Gervasoni 68b56eafea furl remove parameters on search results 2025-07-03 13:35:40 +02:00
Luciano Gervasoni e657c3bee1 Zombie processes, quot parser issue 2025-07-03 10:56:48 +02:00
Luciano Gervasoni 8b689729bf Docker and deployment to fetcher server 2025-06-27 09:14:44 +02:00
Luciano Gervasoni 03a2949b2b django tasks scheduler update, .env and docker compose towards fetcher sca 2025-06-20 00:35:48 +02:00
Luciano Gervasoni 490f01d66c Unknown instead of error for fetched urls 2025-06-19 22:43:29 +02:00
Luciano Gervasoni f59d16b3fc Publish with hidden tag, don't publish if url id already processed, typo 2025-04-24 16:53:52 +02:00
Luciano Gervasoni b3f7cb255c Publish with hidden tag, don't publish if url id already processed 2025-04-24 16:47:14 +02:00
Luciano Gervasoni b8fdcae5ec Temperature and seed LLM 2025-04-23 17:46:47 +02:00
Luciano Gervasoni cf55c586f7 Publisher fix 2025-04-23 17:34:10 +02:00
Luciano Gervasoni e5c574ba33 LLM refactor, NPU ollama based, publisher update json query to llm 2025-04-23 16:35:50 +02:00
Luciano Gervasoni 8d0697edee Publisher task 2025-04-18 16:36:14 +02:00
Luciano Gervasoni 4dd351f4ef Url bypass handle error case 2025-04-16 18:30:31 +02:00
Luciano Gervasoni 95451cdb57 Bypass paywall feature 2025-04-16 12:29:50 +02:00
Luciano Gervasoni 148ec72658 Error URLs proces with marreta. Env vars update 2025-04-16 11:50:55 +02:00
Luciano Gervasoni 43c6c3aabf Clean old url content, use django db connection 2025-04-14 10:48:33 +02:00
Luciano Gervasoni f369b23d81 General search fix, status pattern match regex, find feeds on startup 2025-04-09 15:52:35 +02:00