Commit Graph

122 Commits

Author SHA1 Message Date
Luciano Gervasoni
4985f09e56 Filters fix 2025-07-08 18:28:43 +02:00
Luciano Gervasoni
0cf61026e8 Selenium based fetch of different sources 2025-07-08 18:18:26 +02:00
Luciano Gervasoni
9083021674 Scheduled tasks priorities 2025-07-08 10:15:21 +02:00
Luciano Gervasoni
522c1cb8b3 Missing kids selenium fixes 2025-07-08 09:43:40 +02:00
Luciano Gervasoni
dd8e71aaa3 Missing kid verify timeout handle 2025-07-07 16:51:55 +02:00
Luciano Gervasoni
8cf2b52325 Selenium based missing kid verify url fix (2) 2025-07-07 16:34:21 +02:00
Luciano Gervasoni
a8b236bac0 Selenium based missing kid verify url 2025-07-07 16:02:11 +02:00
Luciano Gervasoni
15035c108d Missing kids processing fix 2025-07-07 13:22:18 +02:00
Luciano Gervasoni
4c0dd70bc3 missing kids status code handling 2025-07-07 12:57:57 +02:00
Luciano Gervasoni
b559f8cd8c Django tasks scheduler 2025-07-04 18:52:56 +02:00
Luciano Gervasoni
737483db9f Tasks timeout 2025-07-04 18:51:09 +02:00
Luciano Gervasoni
d0ae91bf35 quot parser issue fx 2025-07-03 14:13:47 +02:00
Luciano Gervasoni
80f40e1a74 unquote google general search 2025-07-03 13:52:18 +02:00
Luciano Gervasoni
969e08e84a Status pattern match fox news person 2025-07-03 13:43:30 +02:00
Luciano Gervasoni
68b56eafea furl remove parameters on search results 2025-07-03 13:35:40 +02:00
Luciano Gervasoni
e657c3bee1 Zombie processes, quot parser issue 2025-07-03 10:56:48 +02:00
Luciano Gervasoni
8b689729bf Docker and deployment to fetcher server 2025-06-27 09:14:44 +02:00
Luciano Gervasoni
f659d4adb3 Scheduled tasks interval, env vars, view fix 2025-06-20 09:59:27 +02:00
Luciano Gervasoni
03a2949b2b django tasks scheduler update, .env and docker compose towards fetcher sca 2025-06-20 00:35:48 +02:00
Luciano Gervasoni
490f01d66c Unknown instead of error for fetched urls 2025-06-19 22:43:29 +02:00
Luciano Gervasoni
aa369d0458 Publish from filtered URLs option 2025-04-25 16:39:13 +02:00
Luciano Gervasoni
f59d16b3fc Publish with hidden tag, don't publish if url id already processed, typo 2025-04-24 16:53:52 +02:00
Luciano Gervasoni
b3f7cb255c Publish with hidden tag, don't publish if url id already processed 2025-04-24 16:47:14 +02:00
Luciano Gervasoni
b8fdcae5ec Temperature and seed LLM 2025-04-23 17:46:47 +02:00
Luciano Gervasoni
cf55c586f7 Publisher fix 2025-04-23 17:34:10 +02:00
Luciano Gervasoni
e5c574ba33 LLM refactor, NPU ollama based, publisher update json query to llm 2025-04-23 16:35:50 +02:00
Luciano Gervasoni
8d0697edee Publisher task 2025-04-18 16:36:14 +02:00
Luciano Gervasoni
4dd351f4ef Url bypass handle error case 2025-04-16 18:30:31 +02:00
Luciano Gervasoni
95451cdb57 Bypass paywall feature 2025-04-16 12:29:50 +02:00
Luciano Gervasoni
148ec72658 Error URLs proces with marreta. Env vars update 2025-04-16 11:50:55 +02:00
Luciano Gervasoni
b876f6d720 LLM view refactor 2025-04-14 13:49:06 +02:00
Luciano Gervasoni
43c6c3aabf Clean old url content, use django db connection 2025-04-14 10:48:33 +02:00
Luciano Gervasoni
0cd84496cf docker env vars, selenium docker simplified, favicon, settings clean 2025-04-10 10:54:57 +02:00
Luciano Gervasoni
842f3175df Feeds fetcher remove comments 2025-04-09 17:02:49 +02:00
Luciano Gervasoni
9a8322e408 Init data fr update 2025-04-09 16:09:37 +02:00
Luciano Gervasoni
f369b23d81 General search fix, status pattern match regex, find feeds on startup 2025-04-09 15:52:35 +02:00
Luciano Gervasoni
296a8fe8a8 Scheduled tasks timeout, selenium memory leak possible fix 2025-04-07 19:12:36 +02:00
Luciano Gervasoni
1b660f3d2e Debugging missing kids endpoint 2025-04-07 09:37:16 +02:00
Luciano Gervasoni
af3d7e030c Selenium logs, on delete cascade, tasks timeout, parser url host requirement 2025-04-07 09:25:43 +02:00
Luciano Gervasoni
64d2efd314 Reverting to django tasks scheduler version 2025-04-06 21:03:57 +02:00
Luciano Gervasoni
7f246089b9 Scheduler config (2) 2025-04-06 20:46:56 +02:00
Luciano Gervasoni
9c89ec95b0 Scheduler config 2025-04-06 20:45:29 +02:00
Luciano Gervasoni
4011717c34 Url visualize fix, setting job timeout, decode news.google.com debug 2025-04-06 20:31:05 +02:00
Luciano Gervasoni
b55243009a Shuffle fix 3 2025-04-04 21:24:13 +02:00
Luciano Gervasoni
560c2591cb Shuffle fix 2 2025-04-04 21:22:10 +02:00
Luciano Gervasoni
2e28a976d0 Shuffle fix 2025-04-04 21:21:26 +02:00
Luciano Gervasoni
c7cdc559f2 Compose dev mode, shuffle searches, reordering url filters 2025-04-04 21:13:52 +02:00
Luciano Gervasoni
e87f10e7d4 Views update URLs list, job timeout, url content fail debug 2025-04-04 20:11:22 +02:00
Luciano Gervasoni
3e84fc4508 Reverse proxy sample 2025-04-04 17:33:27 +02:00
Luciano Gervasoni
9127552bfd Min num of sources filter, initialization scripts, docker ready to use dev mode 2025-04-04 16:56:27 +02:00