Commit Graph

91 Commits

Author SHA1 Message Date
Luciano Gervasoni
cb621c9d6b Switching to django celery for workers 2025-07-17 22:29:06 +02:00
Luciano Gervasoni
50e8666162 Django tasks workers logger 2025-07-17 00:46:48 +02:00
Luciano Gervasoni
202e58776d Django tasks workers 2025-07-17 00:21:26 +02:00
Luciano Gervasoni
7a91fc1a87 Django tasks workers 2025-07-17 00:11:02 +02:00
Luciano Gervasoni
b2b853b32f Django tasks workers 2025-07-17 00:06:23 +02:00
Luciano Gervasoni
d5d80ade55 Django tasks workers 2025-07-17 00:05:04 +02:00
Luciano Gervasoni
60f021fc2d Logger for worker 2025-07-15 17:05:06 +02:00
Luciano Gervasoni
1dcf69ab08 Logger for worker 2025-07-15 16:58:48 +02:00
Luciano Gervasoni
b9ba0d8f3d Logger for worker 2025-07-15 16:51:22 +02:00
Luciano Gervasoni
06ded0b37d Worker params 2025-07-15 10:28:51 +02:00
Luciano Gervasoni
a38e2bc5d1 Worker logs 2025-07-15 10:04:13 +02:00
Luciano Gervasoni
5a33012a64 Workers fix 2 2025-07-15 01:07:10 +02:00
Luciano Gervasoni
9d79a4e5c4 Workers fix 2025-07-15 01:04:57 +02:00
Luciano Gervasoni
6612a50d13 Logger fix, env sample ram 2025-07-14 23:48:34 +02:00
Luciano Gervasoni
6c88759e7b Workers ttl 2025-07-14 23:37:48 +02:00
Luciano Gervasoni
623dfbf95a Tasks priorities 2025-07-10 14:36:19 +02:00
Luciano Gervasoni
0cb68a876b Logger parent pid 2025-07-10 14:19:57 +02:00
Luciano Gervasoni
fdc3263785 Django multi worker, logging pid 2025-07-10 13:08:37 +02:00
Luciano Gervasoni
0fa4482711 Missing kids trigger types 2025-07-08 21:30:20 +02:00
Luciano Gervasoni
4985f09e56 Filters fix 2025-07-08 18:28:43 +02:00
Luciano Gervasoni
0cf61026e8 Selenium based fetch of different sources 2025-07-08 18:18:26 +02:00
Luciano Gervasoni
9083021674 Scheduled tasks priorities 2025-07-08 10:15:21 +02:00
Luciano Gervasoni
522c1cb8b3 Missing kids selenium fixes 2025-07-08 09:43:40 +02:00
Luciano Gervasoni
dd8e71aaa3 Missing kid verify timeout handle 2025-07-07 16:51:55 +02:00
Luciano Gervasoni
8cf2b52325 Selenium based missing kid verify url fix (2) 2025-07-07 16:34:21 +02:00
Luciano Gervasoni
a8b236bac0 Selenium based missing kid verify url 2025-07-07 16:02:11 +02:00
Luciano Gervasoni
15035c108d Missing kids processing fix 2025-07-07 13:22:18 +02:00
Luciano Gervasoni
4c0dd70bc3 missing kids status code handling 2025-07-07 12:57:57 +02:00
Luciano Gervasoni
b559f8cd8c Django tasks scheduler 2025-07-04 18:52:56 +02:00
Luciano Gervasoni
737483db9f Tasks timeout 2025-07-04 18:51:09 +02:00
Luciano Gervasoni
d0ae91bf35 quot parser issue fx 2025-07-03 14:13:47 +02:00
Luciano Gervasoni
80f40e1a74 unquote google general search 2025-07-03 13:52:18 +02:00
Luciano Gervasoni
969e08e84a Status pattern match fox news person 2025-07-03 13:43:30 +02:00
Luciano Gervasoni
68b56eafea furl remove parameters on search results 2025-07-03 13:35:40 +02:00
Luciano Gervasoni
e657c3bee1 Zombie processes, quot parser issue 2025-07-03 10:56:48 +02:00
Luciano Gervasoni
8b689729bf Docker and deployment to fetcher server 2025-06-27 09:14:44 +02:00
Luciano Gervasoni
f659d4adb3 Scheduled tasks interval, env vars, view fix 2025-06-20 09:59:27 +02:00
Luciano Gervasoni
03a2949b2b django tasks scheduler update, .env and docker compose towards fetcher sca 2025-06-20 00:35:48 +02:00
Luciano Gervasoni
490f01d66c Unknown instead of error for fetched urls 2025-06-19 22:43:29 +02:00
Luciano Gervasoni
aa369d0458 Publish from filtered URLs option 2025-04-25 16:39:13 +02:00
Luciano Gervasoni
f59d16b3fc Publish with hidden tag, don't publish if url id already processed, typo 2025-04-24 16:53:52 +02:00
Luciano Gervasoni
b3f7cb255c Publish with hidden tag, don't publish if url id already processed 2025-04-24 16:47:14 +02:00
Luciano Gervasoni
b8fdcae5ec Temperature and seed LLM 2025-04-23 17:46:47 +02:00
Luciano Gervasoni
cf55c586f7 Publisher fix 2025-04-23 17:34:10 +02:00
Luciano Gervasoni
e5c574ba33 LLM refactor, NPU ollama based, publisher update json query to llm 2025-04-23 16:35:50 +02:00
Luciano Gervasoni
8d0697edee Publisher task 2025-04-18 16:36:14 +02:00
Luciano Gervasoni
4dd351f4ef Url bypass handle error case 2025-04-16 18:30:31 +02:00
Luciano Gervasoni
95451cdb57 Bypass paywall feature 2025-04-16 12:29:50 +02:00
Luciano Gervasoni
148ec72658 Error URLs proces with marreta. Env vars update 2025-04-16 11:50:55 +02:00
Luciano Gervasoni
b876f6d720 LLM view refactor 2025-04-14 13:49:06 +02:00