matitos/matitos_news
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
127 Commits 4 Branches 0 Tags
02f756d3c21a79a8000462d55a7741b4a0e138ba
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Luciano Gervasoni 02f756d3c2 Ride missing kids exception 2025-08-14 10:59:19 +02:00
Luciano Gervasoni 6b5073d1b6 Pattern matching, foxnews request with header 2025-08-13 14:29:44 +02:00
Luciano Gervasoni e3d6cf8000 Pattern matching, foxnews request with header 2025-08-13 14:12:54 +02:00
Luciano Gervasoni 30c586d49a Selenium docker psutil 2025-08-01 20:49:28 +02:00
Luciano Gervasoni 1502f09e22 Selenium kill process to release mem, supervisor conf rotate log file 2025-07-28 11:16:15 +02:00
Luciano Gervasoni 54e41139bb Duckduckgo search update 2025-07-22 22:53:53 +02:00
Luciano Gervasoni b112da8bd0 Supervisor based run 2025-07-22 00:51:09 +02:00
Luciano Gervasoni cb621c9d6b Switching to django celery for workers 2025-07-17 22:29:06 +02:00
Luciano Gervasoni 50e8666162 Django tasks workers logger 2025-07-17 00:46:48 +02:00
Luciano Gervasoni 202e58776d Django tasks workers 2025-07-17 00:21:26 +02:00
Luciano Gervasoni 7a91fc1a87 Django tasks workers 2025-07-17 00:11:02 +02:00
Luciano Gervasoni b2b853b32f Django tasks workers 2025-07-17 00:06:23 +02:00
Luciano Gervasoni d5d80ade55 Django tasks workers 2025-07-17 00:05:04 +02:00
Luciano Gervasoni 60f021fc2d Logger for worker 2025-07-15 17:05:06 +02:00
Luciano Gervasoni 1dcf69ab08 Logger for worker 2025-07-15 16:58:48 +02:00
Luciano Gervasoni b9ba0d8f3d Logger for worker 2025-07-15 16:51:22 +02:00
Luciano Gervasoni 06ded0b37d Worker params 2025-07-15 10:28:51 +02:00
Luciano Gervasoni a38e2bc5d1 Worker logs 2025-07-15 10:04:13 +02:00
Luciano Gervasoni 5a33012a64 Workers fix 2 2025-07-15 01:07:10 +02:00
Luciano Gervasoni 9d79a4e5c4 Workers fix 2025-07-15 01:04:57 +02:00
Luciano Gervasoni 6612a50d13 Logger fix, env sample ram 2025-07-14 23:48:34 +02:00
Luciano Gervasoni 6c88759e7b Workers ttl 2025-07-14 23:37:48 +02:00
Luciano Gervasoni 623dfbf95a Tasks priorities 2025-07-10 14:36:19 +02:00
Luciano Gervasoni 0cb68a876b Logger parent pid 2025-07-10 14:19:57 +02:00
Luciano Gervasoni fdc3263785 Django multi worker, logging pid 2025-07-10 13:08:37 +02:00
Luciano Gervasoni da5dfe5314 Timeout adjust 2025-07-08 21:33:28 +02:00
Luciano Gervasoni 0fa4482711 Missing kids trigger types 2025-07-08 21:30:20 +02:00
Luciano Gervasoni 4985f09e56 Filters fix 2025-07-08 18:28:43 +02:00
Luciano Gervasoni 0cf61026e8 Selenium based fetch of different sources 2025-07-08 18:18:26 +02:00
Luciano Gervasoni f729bd1cb2 Selenium control loop 2025-07-08 10:19:37 +02:00
Luciano Gervasoni 9083021674 Scheduled tasks priorities 2025-07-08 10:15:21 +02:00
Luciano Gervasoni 8d72d3af0c debugging 2025-07-08 10:11:07 +02:00
Luciano Gervasoni 75de046dd9 selenium app wip 2025-07-08 10:01:35 +02:00
Luciano Gervasoni 7fdd93d35d docker compose base prod 2025-07-08 09:48:17 +02:00
Luciano Gervasoni 522c1cb8b3 Missing kids selenium fixes 2025-07-08 09:43:40 +02:00
Luciano Gervasoni e81a96f4bd typo missing kid verif 2025-07-07 17:07:04 +02:00
Luciano Gervasoni dd8e71aaa3 Missing kid verify timeout handle 2025-07-07 16:51:55 +02:00
Luciano Gervasoni 8cf2b52325 Selenium based missing kid verify url fix (2) 2025-07-07 16:34:21 +02:00
Luciano Gervasoni a8b236bac0 Selenium based missing kid verify url 2025-07-07 16:02:11 +02:00
Luciano Gervasoni 15035c108d Missing kids processing fix 2025-07-07 13:22:18 +02:00
Luciano Gervasoni 4c0dd70bc3 missing kids status code handling 2025-07-07 12:57:57 +02:00
Luciano Gervasoni b559f8cd8c Django tasks scheduler 2025-07-04 18:52:56 +02:00
Luciano Gervasoni 737483db9f Tasks timeout 2025-07-04 18:51:09 +02:00
Luciano Gervasoni d0ae91bf35 quot parser issue fx 2025-07-03 14:13:47 +02:00
Luciano Gervasoni 80f40e1a74 unquote google general search 2025-07-03 13:52:18 +02:00
Luciano Gervasoni 969e08e84a Status pattern match fox news person 2025-07-03 13:43:30 +02:00
Luciano Gervasoni 68b56eafea furl remove parameters on search results 2025-07-03 13:35:40 +02:00
Luciano Gervasoni e657c3bee1 Zombie processes, quot parser issue 2025-07-03 10:56:48 +02:00
Luciano Gervasoni 8b689729bf Docker and deployment to fetcher server 2025-06-27 09:14:44 +02:00
Luciano Gervasoni f659d4adb3 Scheduled tasks interval, env vars, view fix 2025-06-20 09:59:27 +02:00
Luciano Gervasoni 03a2949b2b django tasks scheduler update, .env and docker compose towards fetcher sca 2025-06-20 00:35:48 +02:00
Luciano Gervasoni 490f01d66c Unknown instead of error for fetched urls 2025-06-19 22:43:29 +02:00
Luciano Gervasoni a2cce62096 CV app docker fix compose 2025-04-30 22:32:52 +02:00
Luciano Gervasoni aa7aca3e66 CV app docker fix 2025-04-30 22:31:24 +02:00
Luciano Gervasoni d7df5b4ea4 CV app with fastapi, web nicegui based 2025-04-30 18:41:35 +02:00
Luciano Gervasoni ccfd0f9188 Schools NL, Ghost post utils, nude + age detection 2025-04-30 15:50:54 +02:00
Luciano Gervasoni aa369d0458 Publish from filtered URLs option 2025-04-25 16:39:13 +02:00
Luciano Gervasoni f59d16b3fc Publish with hidden tag, don't publish if url id already processed, typo 2025-04-24 16:53:52 +02:00
Luciano Gervasoni b3f7cb255c Publish with hidden tag, don't publish if url id already processed 2025-04-24 16:47:14 +02:00
Luciano Gervasoni b8fdcae5ec Temperature and seed LLM 2025-04-23 17:46:47 +02:00
Luciano Gervasoni cf55c586f7 Publisher fix 2025-04-23 17:34:10 +02:00
Luciano Gervasoni e5c574ba33 LLM refactor, NPU ollama based, publisher update json query to llm 2025-04-23 16:35:50 +02:00
Luciano Gervasoni 8ea3ec1bda Utils 2025-04-23 16:26:08 +02:00
Luciano Gervasoni 8d0697edee Publisher task 2025-04-18 16:36:14 +02:00
Luciano Gervasoni d7373edba2 Compose fix 2 2025-04-16 20:13:56 +02:00
Luciano Gervasoni 1573dff768 Compose fix 2025-04-16 20:11:27 +02:00
Luciano Gervasoni 212d8fb65d Towards ghost setup 2025-04-16 20:10:33 +02:00
Luciano Gervasoni 4dd351f4ef Url bypass handle error case 2025-04-16 18:30:31 +02:00
Luciano Gervasoni 95451cdb57 Bypass paywall feature 2025-04-16 12:29:50 +02:00
Luciano Gervasoni 148ec72658 Error URLs proces with marreta. Env vars update 2025-04-16 11:50:55 +02:00
Luciano Gervasoni b876f6d720 LLM view refactor 2025-04-14 13:49:06 +02:00
Luciano Gervasoni 43c6c3aabf Clean old url content, use django db connection 2025-04-14 10:48:33 +02:00
Luciano Gervasoni 0cd84496cf docker env vars, selenium docker simplified, favicon, settings clean 2025-04-10 10:54:57 +02:00
Luciano Gervasoni 842f3175df Feeds fetcher remove comments 2025-04-09 17:02:49 +02:00
Luciano Gervasoni 9a8322e408 Init data fr update 2025-04-09 16:09:37 +02:00
Luciano Gervasoni f369b23d81 General search fix, status pattern match regex, find feeds on startup 2025-04-09 15:52:35 +02:00
Luciano Gervasoni 296a8fe8a8 Scheduled tasks timeout, selenium memory leak possible fix 2025-04-07 19:12:36 +02:00
Luciano Gervasoni d41fb26a99 Selenium missing kids fix 2025-04-07 13:30:42 +02:00
Luciano Gervasoni 04aed5a0f5 Docker compose build args typo 2 2025-04-07 12:40:21 +02:00
Luciano Gervasoni 91043d27f1 Docker compose build args typo 2025-04-07 12:39:38 +02:00
Luciano Gervasoni d78ade600f MissingKids selenium app fix 2025-04-07 12:38:30 +02:00
Luciano Gervasoni 3867538826 Selenium webdriver arm64 2025-04-07 12:28:11 +02:00
Luciano Gervasoni 7acdf6bc77 Debugging selenium app 2 2025-04-07 09:51:58 +02:00
Luciano Gervasoni 7989eea0d8 Debugging selenium app 2025-04-07 09:50:13 +02:00
Luciano Gervasoni 1b660f3d2e Debugging missing kids endpoint 2025-04-07 09:37:16 +02:00
Luciano Gervasoni af3d7e030c Selenium logs, on delete cascade, tasks timeout, parser url host requirement 2025-04-07 09:25:43 +02:00
Luciano Gervasoni 64d2efd314 Reverting to django tasks scheduler version 2025-04-06 21:03:57 +02:00
Luciano Gervasoni 7f246089b9 Scheduler config (2) 2025-04-06 20:46:56 +02:00
Luciano Gervasoni 9c89ec95b0 Scheduler config 2025-04-06 20:45:29 +02:00
Luciano Gervasoni 4011717c34 Url visualize fix, setting job timeout, decode news.google.com debug 2025-04-06 20:31:05 +02:00
Luciano Gervasoni b55243009a Shuffle fix 3 2025-04-04 21:24:13 +02:00
Luciano Gervasoni 560c2591cb Shuffle fix 2 2025-04-04 21:22:10 +02:00
Luciano Gervasoni 2e28a976d0 Shuffle fix 2025-04-04 21:21:26 +02:00
Luciano Gervasoni c31f83d9b8 Docker compose load balancer 2025-04-04 21:19:25 +02:00
Luciano Gervasoni c7cdc559f2 Compose dev mode, shuffle searches, reordering url filters 2025-04-04 21:13:52 +02:00
Luciano Gervasoni e87f10e7d4 Views update URLs list, job timeout, url content fail debug 2025-04-04 20:11:22 +02:00
Luciano Gervasoni 3e84fc4508 Reverse proxy sample 2025-04-04 17:33:27 +02:00
Luciano Gervasoni 9127552bfd Min num of sources filter, initialization scripts, docker ready to use dev mode 2025-04-04 16:56:27 +02:00
Luciano Gervasoni 76079d7bd0 Wait db connection, login required, dev mode enable 2025-04-04 12:28:22 +02:00
Luciano Gervasoni 4dbe2e55ef Dockerization, whitenoise serving static, refactor 2025-04-04 10:53:16 +02:00