170 Commits

Author SHA1 Message Date
Luciano Gervasoni
f59d16b3fc Publish with hidden tag, don't publish if url id already processed, typo 2025-04-24 16:53:52 +02:00
Luciano Gervasoni
b3f7cb255c Publish with hidden tag, don't publish if url id already processed 2025-04-24 16:47:14 +02:00
Luciano Gervasoni
b8fdcae5ec Temperature and seed LLM 2025-04-23 17:46:47 +02:00
Luciano Gervasoni
cf55c586f7 Publisher fix 2025-04-23 17:34:10 +02:00
Luciano Gervasoni
e5c574ba33 LLM refactor, NPU ollama based, publisher update json query to llm 2025-04-23 16:35:50 +02:00
Luciano Gervasoni
8ea3ec1bda Utils 2025-04-23 16:26:08 +02:00
Luciano Gervasoni
8d0697edee Publisher task 2025-04-18 16:36:14 +02:00
Luciano Gervasoni
d7373edba2 Compose fix 2 2025-04-16 20:13:56 +02:00
Luciano Gervasoni
1573dff768 Compose fix 2025-04-16 20:11:27 +02:00
Luciano Gervasoni
212d8fb65d Towards ghost setup 2025-04-16 20:10:33 +02:00
Luciano Gervasoni
4dd351f4ef Url bypass handle error case 2025-04-16 18:30:31 +02:00
Luciano Gervasoni
95451cdb57 Bypass paywall feature 2025-04-16 12:29:50 +02:00
Luciano Gervasoni
148ec72658 Error URLs proces with marreta. Env vars update 2025-04-16 11:50:55 +02:00
Luciano Gervasoni
b876f6d720 LLM view refactor 2025-04-14 13:49:06 +02:00
Luciano Gervasoni
43c6c3aabf Clean old url content, use django db connection 2025-04-14 10:48:33 +02:00
Luciano Gervasoni
0cd84496cf docker env vars, selenium docker simplified, favicon, settings clean 2025-04-10 10:54:57 +02:00
Luciano Gervasoni
842f3175df Feeds fetcher remove comments 2025-04-09 17:02:49 +02:00
Luciano Gervasoni
9a8322e408 Init data fr update 2025-04-09 16:09:37 +02:00
Luciano Gervasoni
f369b23d81 General search fix, status pattern match regex, find feeds on startup 2025-04-09 15:52:35 +02:00
Luciano Gervasoni
296a8fe8a8 Scheduled tasks timeout, selenium memory leak possible fix 2025-04-07 19:12:36 +02:00
Luciano Gervasoni
d41fb26a99 Selenium missing kids fix 2025-04-07 13:30:42 +02:00
Luciano Gervasoni
04aed5a0f5 Docker compose build args typo 2 2025-04-07 12:40:21 +02:00
Luciano Gervasoni
91043d27f1 Docker compose build args typo 2025-04-07 12:39:38 +02:00
Luciano Gervasoni
d78ade600f MissingKids selenium app fix 2025-04-07 12:38:30 +02:00
Luciano Gervasoni
3867538826 Selenium webdriver arm64 2025-04-07 12:28:11 +02:00
Luciano Gervasoni
7acdf6bc77 Debugging selenium app 2 2025-04-07 09:51:58 +02:00
Luciano Gervasoni
7989eea0d8 Debugging selenium app 2025-04-07 09:50:13 +02:00
Luciano Gervasoni
1b660f3d2e Debugging missing kids endpoint 2025-04-07 09:37:16 +02:00
Luciano Gervasoni
af3d7e030c Selenium logs, on delete cascade, tasks timeout, parser url host requirement 2025-04-07 09:25:43 +02:00
Luciano Gervasoni
64d2efd314 Reverting to django tasks scheduler version 2025-04-06 21:03:57 +02:00
Luciano Gervasoni
7f246089b9 Scheduler config (2) 2025-04-06 20:46:56 +02:00
Luciano Gervasoni
9c89ec95b0 Scheduler config 2025-04-06 20:45:29 +02:00
Luciano Gervasoni
4011717c34 Url visualize fix, setting job timeout, decode news.google.com debug 2025-04-06 20:31:05 +02:00
Luciano Gervasoni
b55243009a Shuffle fix 3 2025-04-04 21:24:13 +02:00
Luciano Gervasoni
560c2591cb Shuffle fix 2 2025-04-04 21:22:10 +02:00
Luciano Gervasoni
2e28a976d0 Shuffle fix 2025-04-04 21:21:26 +02:00
Luciano Gervasoni
c31f83d9b8 Docker compose load balancer 2025-04-04 21:19:25 +02:00
Luciano Gervasoni
c7cdc559f2 Compose dev mode, shuffle searches, reordering url filters 2025-04-04 21:13:52 +02:00
Luciano Gervasoni
e87f10e7d4 Views update URLs list, job timeout, url content fail debug 2025-04-04 20:11:22 +02:00
Luciano Gervasoni
3e84fc4508 Reverse proxy sample 2025-04-04 17:33:27 +02:00
Luciano Gervasoni
9127552bfd Min num of sources filter, initialization scripts, docker ready to use dev mode 2025-04-04 16:56:27 +02:00
Luciano Gervasoni
76079d7bd0 Wait db connection, login required, dev mode enable 2025-04-04 12:28:22 +02:00
Luciano Gervasoni
4dbe2e55ef Dockerization, whitenoise serving static, refactor 2025-04-04 10:53:16 +02:00
Luciano Gervasoni
5addfa5ba9 Valid content filter, language detect on min chars, fetch missingkids.org 2025-04-03 09:44:46 +02:00
Luciano Gervasoni
3b54e247e7 Fetch search fix 2025-04-02 22:39:51 +02:00
Luciano Gervasoni
84da104dc8 Refactor searches, env vars fetcher config, urls webpage update 2025-04-02 18:45:43 +02:00
Luciano Gervasoni
077219fcb6 Better lang detect, fetch parser handling, rss google news search 2025-03-31 17:44:53 +02:00
Luciano Gervasoni
b3f896b35a Process all missing kids task, urls views cleaner, adding language filter WIP 2025-03-28 16:21:35 +01:00
Luciano Gervasoni
e34284abbe Dependencies for other languages, scheduled tasks import, logs per type, home button filter urls 2025-03-27 15:56:02 +01:00
Luciano Gervasoni
a6b25fe915 Days handling URLs visualization, exception handling url_processor 2025-03-27 12:32:18 +01:00