← Workers

auto-va-vaautocr-2

| 100 lines
Lines: 100 200 500 2000 |
12026-09-20 08:25:57,047 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484191/ping "HTTP/1.1 200 OK"
22026-09-20 08:26:27,118 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484191/ping "HTTP/1.1 200 OK"
32026-09-20 08:26:57,216 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484191/ping "HTTP/1.1 200 OK"
42026-09-20 08:27:27,280 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484191/ping "HTTP/1.1 200 OK"
52026-09-20 08:27:57,370 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484191/ping "HTTP/1.1 200 OK"
62026-09-20 08:28:27,436 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484191/ping "HTTP/1.1 200 OK"
72026-09-20 08:28:33,531 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
82026-09-20 08:28:33,627 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484191/result/details "HTTP/1.1 200 OK"
92026-09-20 08:28:33,637 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484191/status "HTTP/1.1 200 OK"
102026-09-20 08:28:33,638 [INFO] worker: Task 484191 succeeded. Total completed: 912.
112026-09-20 08:28:33,646 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
122026-09-20 08:28:33,646 [INFO] worker: Executing task 484190 (businessId range [997901, 998001), concurrency=3)
132026-09-20 08:29:03,709 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/ping "HTTP/1.1 200 OK"
142026-09-20 08:29:33,783 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/ping "HTTP/1.1 200 OK"
152026-09-20 08:30:03,848 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/ping "HTTP/1.1 200 OK"
162026-09-20 08:30:33,917 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/ping "HTTP/1.1 200 OK"
172026-09-20 08:31:03,986 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/ping "HTTP/1.1 200 OK"
182026-09-20 08:31:34,063 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/ping "HTTP/1.1 200 OK"
192026-09-20 08:32:04,122 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/ping "HTTP/1.1 200 OK"
202026-09-20 08:32:21,233 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
212026-09-20 08:32:21,322 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/result/details "HTTP/1.1 200 OK"
222026-09-20 08:32:21,339 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484190/status "HTTP/1.1 200 OK"
232026-09-20 08:32:21,341 [INFO] worker: Task 484190 succeeded. Total completed: 913.
242026-09-20 08:32:21,357 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
252026-09-20 08:32:21,360 [INFO] worker: Executing task 484192 (businessId range [998101, 998201), concurrency=3)
262026-09-20 08:32:51,417 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/ping "HTTP/1.1 200 OK"
272026-09-20 08:33:21,490 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/ping "HTTP/1.1 200 OK"
282026-09-20 08:33:51,564 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/ping "HTTP/1.1 200 OK"
292026-09-20 08:34:21,647 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/ping "HTTP/1.1 200 OK"
302026-09-20 08:34:51,716 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/ping "HTTP/1.1 200 OK"
312026-09-20 08:35:21,788 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/ping "HTTP/1.1 200 OK"
322026-09-20 08:35:51,853 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/ping "HTTP/1.1 200 OK"
332026-09-20 08:36:07,506 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
342026-09-20 08:36:07,601 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/result/details "HTTP/1.1 200 OK"
352026-09-20 08:36:07,612 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484192/status "HTTP/1.1 200 OK"
362026-09-20 08:36:07,613 [INFO] worker: Task 484192 succeeded. Total completed: 914.
372026-09-20 08:36:07,624 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
382026-09-20 08:36:07,625 [INFO] worker: Executing task 484200 (businessId range [998901, 999001), concurrency=3)
392026-09-20 08:36:37,692 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/ping "HTTP/1.1 200 OK"
402026-09-20 08:37:07,767 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/ping "HTTP/1.1 200 OK"
412026-09-20 08:37:37,835 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/ping "HTTP/1.1 200 OK"
422026-09-20 08:38:07,914 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/ping "HTTP/1.1 200 OK"
432026-09-20 08:38:38,009 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/ping "HTTP/1.1 200 OK"
442026-09-20 08:39:08,087 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/ping "HTTP/1.1 200 OK"
452026-09-20 08:39:38,149 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/ping "HTTP/1.1 200 OK"
462026-09-20 08:39:46,350 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
472026-09-20 08:39:46,437 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/result/details "HTTP/1.1 200 OK"
482026-09-20 08:39:46,453 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484200/status "HTTP/1.1 200 OK"
492026-09-20 08:39:46,455 [INFO] worker: Task 484200 succeeded. Total completed: 915.
502026-09-20 08:39:46,471 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
512026-09-20 08:39:46,473 [INFO] worker: Executing task 484203 (businessId range [999201, 999301), concurrency=3)
522026-09-20 08:40:16,548 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/ping "HTTP/1.1 200 OK"
532026-09-20 08:40:46,635 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/ping "HTTP/1.1 200 OK"
542026-09-20 08:41:16,715 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/ping "HTTP/1.1 200 OK"
552026-09-20 08:41:46,782 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/ping "HTTP/1.1 200 OK"
562026-09-20 08:42:16,856 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/ping "HTTP/1.1 200 OK"
572026-09-20 08:42:46,946 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/ping "HTTP/1.1 200 OK"
582026-09-20 08:43:17,022 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/ping "HTTP/1.1 200 OK"
592026-09-20 08:43:33,158 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
602026-09-20 08:43:33,226 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/result/details "HTTP/1.1 200 OK"
612026-09-20 08:43:33,236 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484203/status "HTTP/1.1 200 OK"
622026-09-20 08:43:33,237 [INFO] worker: Task 484203 succeeded. Total completed: 916.
632026-09-20 08:43:33,245 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
642026-09-20 08:43:33,246 [INFO] worker: Executing task 484209 (businessId range [999801, 999901), concurrency=3)
652026-09-20 08:43:37,852 [ERROR] worker: Scraper subprocess exited 1: 2026-09-20 08:43:33,950 [INFO] worker_entry: worker_entry: crawl businessId [999801, 999901) concurrency=3 headless=True
662026-09-20 08:43:33,950 [INFO] va.browser.proxy_manager: Loaded 20 proxies from /scraper/proxies/proxies_working.txt
672026-09-20 08:43:33,950 [INFO] worker_entry: Loaded bulk index: /data/entities.db
682026-09-20 08:43:37,812 [ERROR] worker_entry: Crawl failed: Page.goto: net::ERR_TUNNEL_CONNECTION_FAILED at https://cis.scc.virginia.gov/EntitySearch/Index
69Call log:
70  - navigating
712026-09-20 08:43:37,852 [INFO] worker: Scraper finished: status=fail businesses=0 total_count=0
722026-09-20 08:43:37,867 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/status "HTTP/1.1 200 OK"
732026-09-20 08:43:37,868 [WARNING] worker: Task 484209 failed. Consecutive failures: 1/5.
742026-09-20 08:43:37,881 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
752026-09-20 08:43:37,882 [INFO] worker: Executing task 484210 (businessId range [999901, 1000001), concurrency=3)
762026-09-20 08:44:07,947 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/ping "HTTP/1.1 200 OK"
772026-09-20 08:44:38,022 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/ping "HTTP/1.1 200 OK"
782026-09-20 08:45:08,122 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/ping "HTTP/1.1 200 OK"
792026-09-20 08:45:38,180 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/ping "HTTP/1.1 200 OK"
802026-09-20 08:46:08,266 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/ping "HTTP/1.1 200 OK"
812026-09-20 08:46:38,323 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/ping "HTTP/1.1 200 OK"
822026-09-20 08:47:08,403 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/ping "HTTP/1.1 200 OK"
832026-09-20 08:47:25,002 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
842026-09-20 08:47:25,096 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/result/details "HTTP/1.1 200 OK"
852026-09-20 08:47:25,112 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484210/status "HTTP/1.1 200 OK"
862026-09-20 08:47:25,113 [INFO] worker: Task 484210 succeeded. Total completed: 917.
872026-09-20 08:47:25,125 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
882026-09-20 08:47:35,174 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
892026-09-20 08:47:45,223 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
902026-09-20 08:47:55,283 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
912026-09-20 08:48:05,341 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
922026-09-20 08:48:15,398 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
932026-09-20 08:48:25,444 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
942026-09-20 08:48:35,958 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
952026-09-20 08:48:46,032 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
962026-09-20 08:48:56,067 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
972026-09-20 08:49:06,126 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
982026-09-20 08:49:16,174 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
992026-09-20 08:49:26,417 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
1002026-09-20 08:49:29,176 [INFO] worker: Signal 15 received — finishing current task then stopping.