170 Commits

Author SHA1 Message Date
Luciano Gervasoni
cb621c9d6b Switching to django celery for workers 2025-07-17 22:29:06 +02:00
Luciano Gervasoni
50e8666162 Django tasks workers logger 2025-07-17 00:46:48 +02:00
Luciano Gervasoni
202e58776d Django tasks workers 2025-07-17 00:21:26 +02:00
Luciano Gervasoni
7a91fc1a87 Django tasks workers 2025-07-17 00:11:02 +02:00
Luciano Gervasoni
b2b853b32f Django tasks workers 2025-07-17 00:06:23 +02:00
Luciano Gervasoni
d5d80ade55 Django tasks workers 2025-07-17 00:05:04 +02:00
Luciano Gervasoni
60f021fc2d Logger for worker 2025-07-15 17:05:06 +02:00
Luciano Gervasoni
1dcf69ab08 Logger for worker 2025-07-15 16:58:48 +02:00
Luciano Gervasoni
b9ba0d8f3d Logger for worker 2025-07-15 16:51:22 +02:00
Luciano Gervasoni
06ded0b37d Worker params 2025-07-15 10:28:51 +02:00
Luciano Gervasoni
a38e2bc5d1 Worker logs 2025-07-15 10:04:13 +02:00
Luciano Gervasoni
5a33012a64 Workers fix 2 2025-07-15 01:07:10 +02:00
Luciano Gervasoni
9d79a4e5c4 Workers fix 2025-07-15 01:04:57 +02:00
Luciano Gervasoni
6612a50d13 Logger fix, env sample ram 2025-07-14 23:48:34 +02:00
Luciano Gervasoni
6c88759e7b Workers ttl 2025-07-14 23:37:48 +02:00
Luciano Gervasoni
623dfbf95a Tasks priorities 2025-07-10 14:36:19 +02:00
Luciano Gervasoni
0cb68a876b Logger parent pid 2025-07-10 14:19:57 +02:00
Luciano Gervasoni
fdc3263785 Django multi worker, logging pid 2025-07-10 13:08:37 +02:00
Luciano Gervasoni
da5dfe5314 Timeout adjust 2025-07-08 21:33:28 +02:00
Luciano Gervasoni
0fa4482711 Missing kids trigger types 2025-07-08 21:30:20 +02:00
Luciano Gervasoni
4985f09e56 Filters fix 2025-07-08 18:28:43 +02:00
Luciano Gervasoni
0cf61026e8 Selenium based fetch of different sources 2025-07-08 18:18:26 +02:00
Luciano Gervasoni
f729bd1cb2 Selenium control loop 2025-07-08 10:19:37 +02:00
Luciano Gervasoni
9083021674 Scheduled tasks priorities 2025-07-08 10:15:21 +02:00
Luciano Gervasoni
8d72d3af0c debugging 2025-07-08 10:11:07 +02:00
Luciano Gervasoni
75de046dd9 selenium app wip 2025-07-08 10:01:35 +02:00
Luciano Gervasoni
7fdd93d35d docker compose base prod 2025-07-08 09:48:17 +02:00
Luciano Gervasoni
522c1cb8b3 Missing kids selenium fixes 2025-07-08 09:43:40 +02:00
Luciano Gervasoni
e81a96f4bd typo missing kid verif 2025-07-07 17:07:04 +02:00
Luciano Gervasoni
dd8e71aaa3 Missing kid verify timeout handle 2025-07-07 16:51:55 +02:00
Luciano Gervasoni
8cf2b52325 Selenium based missing kid verify url fix (2) 2025-07-07 16:34:21 +02:00
Luciano Gervasoni
a8b236bac0 Selenium based missing kid verify url 2025-07-07 16:02:11 +02:00
Luciano Gervasoni
15035c108d Missing kids processing fix 2025-07-07 13:22:18 +02:00
Luciano Gervasoni
4c0dd70bc3 missing kids status code handling 2025-07-07 12:57:57 +02:00
Luciano Gervasoni
b559f8cd8c Django tasks scheduler 2025-07-04 18:52:56 +02:00
Luciano Gervasoni
737483db9f Tasks timeout 2025-07-04 18:51:09 +02:00
Luciano Gervasoni
d0ae91bf35 quot parser issue fx 2025-07-03 14:13:47 +02:00
Luciano Gervasoni
80f40e1a74 unquote google general search 2025-07-03 13:52:18 +02:00
Luciano Gervasoni
969e08e84a Status pattern match fox news person 2025-07-03 13:43:30 +02:00
Luciano Gervasoni
68b56eafea furl remove parameters on search results 2025-07-03 13:35:40 +02:00
Luciano Gervasoni
e657c3bee1 Zombie processes, quot parser issue 2025-07-03 10:56:48 +02:00
Luciano Gervasoni
8b689729bf Docker and deployment to fetcher server 2025-06-27 09:14:44 +02:00
Luciano Gervasoni
f659d4adb3 Scheduled tasks interval, env vars, view fix 2025-06-20 09:59:27 +02:00
Luciano Gervasoni
03a2949b2b django tasks scheduler update, .env and docker compose towards fetcher sca 2025-06-20 00:35:48 +02:00
Luciano Gervasoni
490f01d66c Unknown instead of error for fetched urls 2025-06-19 22:43:29 +02:00
Luciano Gervasoni
a2cce62096 CV app docker fix compose 2025-04-30 22:32:52 +02:00
Luciano Gervasoni
aa7aca3e66 CV app docker fix 2025-04-30 22:31:24 +02:00
Luciano Gervasoni
d7df5b4ea4 CV app with fastapi, web nicegui based 2025-04-30 18:41:35 +02:00
Luciano Gervasoni
ccfd0f9188 Schools NL, Ghost post utils, nude + age detection 2025-04-30 15:50:54 +02:00
Luciano Gervasoni
aa369d0458 Publish from filtered URLs option 2025-04-25 16:39:13 +02:00