← Workers

auto-va-vaautocr-4

| 100 lines
Lines: 100 200 500 2000 |
12026-09-20 08:26:08,427 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
22026-09-20 08:26:08,540 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484187/result/details "HTTP/1.1 200 OK"
32026-09-20 08:26:08,553 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484187/status "HTTP/1.1 200 OK"
42026-09-20 08:26:08,553 [INFO] worker: Task 484187 succeeded. Total completed: 912.
52026-09-20 08:26:08,567 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
62026-09-20 08:26:08,568 [INFO] worker: Executing task 484175 (businessId range [996401, 996501), concurrency=3)
72026-09-20 08:26:38,624 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/ping "HTTP/1.1 200 OK"
82026-09-20 08:27:08,685 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/ping "HTTP/1.1 200 OK"
92026-09-20 08:27:38,760 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/ping "HTTP/1.1 200 OK"
102026-09-20 08:28:08,821 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/ping "HTTP/1.1 200 OK"
112026-09-20 08:28:38,884 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/ping "HTTP/1.1 200 OK"
122026-09-20 08:29:08,958 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/ping "HTTP/1.1 200 OK"
132026-09-20 08:29:39,025 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/ping "HTTP/1.1 200 OK"
142026-09-20 08:29:46,317 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
152026-09-20 08:29:46,393 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/result/details "HTTP/1.1 200 OK"
162026-09-20 08:29:46,410 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484175/status "HTTP/1.1 200 OK"
172026-09-20 08:29:46,414 [INFO] worker: Task 484175 succeeded. Total completed: 913.
182026-09-20 08:29:46,428 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
192026-09-20 08:29:46,431 [INFO] worker: Executing task 484194 (businessId range [998301, 998401), concurrency=3)
202026-09-20 08:30:16,496 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/ping "HTTP/1.1 200 OK"
212026-09-20 08:30:46,575 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/ping "HTTP/1.1 200 OK"
222026-09-20 08:31:16,674 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/ping "HTTP/1.1 200 OK"
232026-09-20 08:31:46,745 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/ping "HTTP/1.1 200 OK"
242026-09-20 08:32:16,798 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/ping "HTTP/1.1 200 OK"
252026-09-20 08:32:46,855 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/ping "HTTP/1.1 200 OK"
262026-09-20 08:33:16,933 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/ping "HTTP/1.1 200 OK"
272026-09-20 08:33:30,041 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
282026-09-20 08:33:30,114 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/result/details "HTTP/1.1 200 OK"
292026-09-20 08:33:30,130 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484194/status "HTTP/1.1 200 OK"
302026-09-20 08:33:30,132 [INFO] worker: Task 484194 succeeded. Total completed: 914.
312026-09-20 08:33:30,150 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
322026-09-20 08:33:30,153 [INFO] worker: Executing task 484197 (businessId range [998601, 998701), concurrency=3)
332026-09-20 08:33:34,956 [ERROR] worker: Scraper subprocess exited 1: 2026-09-20 08:33:30,781 [INFO] worker_entry: worker_entry: crawl businessId [998601, 998701) concurrency=3 headless=True
342026-09-20 08:33:30,782 [INFO] va.browser.proxy_manager: Loaded 20 proxies from /scraper/proxies/proxies_working.txt
352026-09-20 08:33:30,782 [INFO] worker_entry: Loaded bulk index: /data/entities.db
362026-09-20 08:33:34,910 [ERROR] worker_entry: Crawl failed: Page.goto: net::ERR_TUNNEL_CONNECTION_FAILED at https://cis.scc.virginia.gov/EntitySearch/Index
37Call log:
38  - navigating
392026-09-20 08:33:34,956 [INFO] worker: Scraper finished: status=fail businesses=0 total_count=0
402026-09-20 08:33:34,985 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484197/status "HTTP/1.1 200 OK"
412026-09-20 08:33:34,986 [WARNING] worker: Task 484197 failed. Consecutive failures: 1/5.
422026-09-20 08:33:34,997 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
432026-09-20 08:33:34,997 [INFO] worker: Executing task 484198 (businessId range [998701, 998801), concurrency=3)
442026-09-20 08:34:05,052 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/ping "HTTP/1.1 200 OK"
452026-09-20 08:34:35,120 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/ping "HTTP/1.1 200 OK"
462026-09-20 08:35:05,199 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/ping "HTTP/1.1 200 OK"
472026-09-20 08:35:35,267 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/ping "HTTP/1.1 200 OK"
482026-09-20 08:36:05,353 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/ping "HTTP/1.1 200 OK"
492026-09-20 08:36:35,408 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/ping "HTTP/1.1 200 OK"
502026-09-20 08:37:05,854 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/ping "HTTP/1.1 200 OK"
512026-09-20 08:37:16,525 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
522026-09-20 08:37:16,622 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/result/details "HTTP/1.1 200 OK"
532026-09-20 08:37:16,638 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484198/status "HTTP/1.1 200 OK"
542026-09-20 08:37:16,639 [INFO] worker: Task 484198 succeeded. Total completed: 915.
552026-09-20 08:37:16,655 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
562026-09-20 08:37:16,657 [INFO] worker: Executing task 475210 (businessId range [99901, 100001), concurrency=3)
572026-09-20 08:37:46,746 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/ping "HTTP/1.1 200 OK"
582026-09-20 08:38:17,013 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/ping "HTTP/1.1 200 OK"
592026-09-20 08:38:47,075 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/ping "HTTP/1.1 200 OK"
602026-09-20 08:39:17,155 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/ping "HTTP/1.1 200 OK"
612026-09-20 08:39:47,235 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/ping "HTTP/1.1 200 OK"
622026-09-20 08:40:17,296 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/ping "HTTP/1.1 200 OK"
632026-09-20 08:40:47,377 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/ping "HTTP/1.1 200 OK"
642026-09-20 08:41:05,949 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
652026-09-20 08:41:06,033 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/result/details "HTTP/1.1 200 OK"
662026-09-20 08:41:06,043 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/475210/status "HTTP/1.1 200 OK"
672026-09-20 08:41:06,044 [INFO] worker: Task 475210 succeeded. Total completed: 916.
682026-09-20 08:41:06,053 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
692026-09-20 08:41:06,054 [INFO] worker: Executing task 484205 (businessId range [999401, 999501), concurrency=3)
702026-09-20 08:41:36,348 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/ping "HTTP/1.1 200 OK"
712026-09-20 08:42:06,421 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/ping "HTTP/1.1 200 OK"
722026-09-20 08:42:36,480 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/ping "HTTP/1.1 200 OK"
732026-09-20 08:43:06,576 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/ping "HTTP/1.1 200 OK"
742026-09-20 08:43:36,657 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/ping "HTTP/1.1 200 OK"
752026-09-20 08:44:06,764 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/ping "HTTP/1.1 200 OK"
762026-09-20 08:44:36,836 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/ping "HTTP/1.1 200 OK"
772026-09-20 08:44:51,760 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
782026-09-20 08:44:51,848 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/result/details "HTTP/1.1 200 OK"
792026-09-20 08:44:51,868 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484205/status "HTTP/1.1 200 OK"
802026-09-20 08:44:51,871 [INFO] worker: Task 484205 succeeded. Total completed: 917.
812026-09-20 08:44:51,886 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
822026-09-20 08:45:01,949 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
832026-09-20 08:45:11,995 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
842026-09-20 08:45:22,044 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
852026-09-20 08:45:32,084 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
862026-09-20 08:45:32,085 [INFO] worker: Executing task 484209 (businessId range [999801, 999901), concurrency=3)
872026-09-20 08:46:02,152 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/ping "HTTP/1.1 200 OK"
882026-09-20 08:46:32,220 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/ping "HTTP/1.1 200 OK"
892026-09-20 08:47:02,290 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/ping "HTTP/1.1 200 OK"
902026-09-20 08:47:32,357 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/ping "HTTP/1.1 200 OK"
912026-09-20 08:48:02,412 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/ping "HTTP/1.1 200 OK"
922026-09-20 08:48:32,499 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/ping "HTTP/1.1 200 OK"
932026-09-20 08:49:02,587 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/ping "HTTP/1.1 200 OK"
942026-09-20 08:49:22,123 [INFO] worker: Scraper finished: status=complete businesses=100 total_count=100
952026-09-20 08:49:22,223 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/result/details "HTTP/1.1 200 OK"
962026-09-20 08:49:22,314 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/484209/status "HTTP/1.1 200 OK"
972026-09-20 08:49:22,316 [INFO] worker: Task 484209 succeeded. Total completed: 918.
982026-09-20 08:49:22,328 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
992026-09-20 08:49:32,381 [INFO] httpx: HTTP Request: POST https://va.api.bbops.io/api/tasks/lease "HTTP/1.1 200 OK"
1002026-09-20 08:49:34,292 [INFO] worker: Signal 15 received — finishing current task then stopping.