| 2026-06-27 20:36:16.669 · INFO · proxy-server · common |
| [http_server.go:275] [HTTP] 2026/06/27 - 20:36:16 | 200 | 6.531707ms | 192.168.101.204 | POST "/api/proxypool/claim" › |
| 2026-06-27 20:36:16.667 · INFO · cbg-trade · test |
| [spider.go:665] [roleflow][b552247328@163.com][proxy:http://drqe16q2:drqe16q2@115.231.37.230:1980] process page success, page: 19, tryCount: 0, http_status: 200, equip_count: 15, total_pages: 100, is_last_page: false, request_id: f349443f-f342-46ec-b4d7-cd8ec45d8aee › |
| 2026-06-27 20:36:16.665 · INFO · proxy-server · common |
| [provider_duomi.go:358] [duomi-pool] take proxy success, proxy=117.65.1.161:16001, age=11s › |
| 2026-06-27 20:36:16.665 · INFO · proxy-server · common |
| [provider_duomi.go:397] [duomi-pool] drop expired items, count=2, pool_size=6 › |
| 2026-06-27 20:36:16.632 · INFO · cbg-item · test |
| [import_queue.go:252] Redis import queue worker 1 drained queue to empty › |
| 2026-06-27 20:36:16.564 · INFO · cbg-trade · test |
| [spider.go:692] [subflow][yidh8007@163.com][proxy:http://bxma12d1:bxma12d1@115.231.37.193:7814] targetUrl: https://xyq-m.cbg.163.com/cgi-bin/recommend.py?act=recommd_by_role&client_type=h5&count=15&exposed_scene_id=1782563776045-2bc431d7&exter=direct&order_by=selling_time+DESC&page=1&page_session_id=ad016e43-9666-400b-9c20-53b9a0725934&pass_fair_show=0&price_max=29999&price_min=1100&refer_sn=0199DD76-2921-DD29-B209-1E1B740B311B&search_type=query&serverid=212&special_mode=and&view_loc=search_cond%7Ctag_key%3A%7B%7D proxyUrl: http://140.250.148.114:15001 username password › |
| 2026-06-27 20:36:16.515 · INFO · proxy-server · common |
| [provider_duomi.go:304] [duomi-pool] refresh success, apikey=0c****99, fetched=1, added=1, duplicate=0, pool_size=4 › |
| 2026-06-27 20:36:16.451 · INFO · cbg-item · test |
| [import_queue.go:252] Redis import queue worker 4 drained queue to empty › |
| 2026-06-27 20:36:16.413 · INFO · cbg-item · test |
| [import_queue.go:252] Redis import queue worker 3 drained queue to empty › |
| 2026-06-27 20:36:16.402 · INFO · cbg-item · test |
| [import_item.go:226] ImportItemAsyncInternal skip known item: eid=202606261300113-344-M8M3FOD7IVRS › |
| 2026-06-27 20:36:16.234 · INFO · proxy-server · common |
| [provider_duomi.go:304] [duomi-pool] refresh success, apikey=80****23, fetched=1, added=1, duplicate=0, pool_size=7 › |
| 2026-06-27 20:36:16.146 · INFO · cbg-trade · test |
| [spider.go:493] [subflow][mk3hsnujke@163.com][proxy:http://yhgw23r2:yhgw23r2@115.223.47.136:5858] finish server fetch, server_id: 132, page: 3, process: 18, skip: 12 › |
| 2026-06-27 20:36:16.146 · INFO · cbg-trade · test |
| [spider.go:428] [subflow][mk3hsnujke@163.com][proxy:http://yhgw23r2:yhgw23r2@115.223.47.136:5858] start server fetch, group_id: 1, server_id: 326, time_limit: 10, skip_limit: 200, checkpoint_enabled: true, checkpoint_overlap: 5m0s, checkpoint_cutoff: 2026-06-27 20:23:27, page_session_id: f451b5fa-cf65-4cff-9c66-38d70f7af90d, exposed_scene_id: 1782563776146-1fd0d542 › |
| 2026-06-27 20:36:16.145 · INFO · cbg-trade · test |
| [spider.go:490] [subflow][mk3hsnujke@163.com][proxy:http://yhgw23r2:yhgw23r2@115.223.47.136:5858] saved sub flow checkpoint, group_id: 1, server_id: 132, last_selling_time: 2026-06-27 20:35:51 › |
| 2026-06-27 20:36:16.141 · INFO · cbg-trade · test |
| [spider.go:270] [subflow][mk3hsnujke@163.com][proxy:http://yhgw23r2:yhgw23r2@115.223.47.136:5858] reach sub flow checkpoint cutoff, eid: 202606272000113-132-AAN1CSZQARKN, selling_time: 2026-06-27 20:20:51, cutoff: 2026-06-27 20:22:02 › |
| 2026-06-27 20:36:16.141 · INFO · cbg-trade · test |
| [spider.go:461] [subflow][mk3hsnujke@163.com][proxy:http://yhgw23r2:yhgw23r2@115.223.47.136:5858] stop server fetch by checkpoint, server_id: 132, page: 2, process: 18, skip: 12, cutoff: 2026-06-27 20:22:02 › |
| 2026-06-27 20:36:16.120 · INFO · cbg-trade · test |
| [spider.go:803] [subflow][mk3hsnujke@163.com][proxy:http://yhgw23r2:yhgw23r2@115.223.47.136:5858] process page success, server_id: 132, page: 2, tryCount: 0, http_status: 200, equip_count: 15, total_pages: 100, is_last_page: false, request_id: db61e234-6757-4955-adff-9f485eaad6ca › |
| 2026-06-27 20:36:16.072 · INFO · cbg-trade · test |
| [common.go:106] eid already exists, skip adding log, eid: 202606231700113-730-4PFGMLC5X6H9 › |
| 2026-06-27 20:36:16.050 · WARN · cbg-item · test |
| [import_item.go:369] ImportItem request missing eid › |
| 2026-06-27 20:36:16.052 · WARN · cbg-item · test |
| [import_item.go:369] ImportItem request missing eid › |