| 2026-09-02 01:03:51.632 · INFO · cbg-trade · test |
| [eidtype.go:79] [eid_type] upstream lookup succeeded, eid=202609020100113-730-MEFUUWCVGO9P server_id=730 reason=value status=1 status_code=OK kind_id=30 equip_type=3740 listing_status=2 › |
| 2026-09-02 01:03:51.141 · INFO · cbg-item · test |
| [cache.go:351] flush status update batch table=pet_5 size=500 › |
| 2026-09-02 01:03:51.140 · INFO · cbg-item · test |
| [cache.go:312] status update cache clickhouse batch updated table=pet_5 batch_size=500 first_eid=202608150600113-72-PUUK1JWM26VGL last_eid=202608181300113-967-RCR0YUME2IJE › |
| 2026-09-02 01:03:47.955 · INFO · cbg-item · test |
| [cache.go:351] flush status update batch table=pet_5 size=500 › |
| 2026-09-02 01:03:47.856 · INFO · cbg-item · test |
| [cache.go:312] status update cache clickhouse batch updated table=pet_5 batch_size=500 first_eid=202608111500113-901-HCGW0UZSUUSJ last_eid=202608150600113-459-ZDEJ1ODGB68S › |
| 2026-09-02 01:03:47.856 · INFO · cbg-item · test |
| [cache.go:269] status update cache flush table progress table=pet_5 flushed=2000 failed=0 pending_start=7912 › |
| 2026-09-02 01:03:46.695 · INFO · cbg-trade · test |
| [random_push_review.go:194] role get random push review, token: OFEC-HKDP-6083-2995 › |
| 2026-09-02 01:03:45.900 · INFO · cbg-trade · test |
| [random_push_review.go:194] role get random push review, token: OFEC-HKDP-6083-2995 › |
| 2026-09-02 01:03:44.444 · INFO · cbg-item · test |
| [cache.go:312] status update cache clickhouse batch updated table=pet_5 batch_size=500 first_eid=202608111300113-197-VHP6D3XBDKZO last_eid=202608111500113-892-0O2Q2G964Z2G › |
| 2026-09-02 01:03:44.444 · INFO · cbg-item · test |
| [cache.go:351] flush status update batch table=pet_5 size=500 › |
| 2026-09-02 01:03:40.544 · INFO · cbg-trade · test |
| [eidtype.go:79] [eid_type] upstream lookup succeeded, eid=202204221500113-856-VJXEF1A7VWNS server_id=856 reason=value status=1 status_code=OK kind_id=51 equip_type=999 listing_status=2 › |
| 2026-09-02 01:03:40.350 · INFO · cbg-item · test |
| [cache.go:351] flush status update batch table=pet_5 size=500 › |
| 2026-09-02 01:03:40.234 · INFO · cbg-item · test |
| [cache.go:312] status update cache clickhouse batch updated table=pet_5 batch_size=500 first_eid=202608111000113-554-5QTPTVIYGUBQ last_eid=202608111300113-197-EDPDNQCHVAHJ › |
| 2026-09-02 01:03:40.234 · INFO · cbg-item · test |
| [cache.go:269] status update cache flush table progress table=pet_5 flushed=1000 failed=0 pending_start=7912 › |
| 2026-09-02 01:03:38.896 · INFO · cbg-trade · test |
| [random_push_review.go:194] role get random push review, token: OFEC-HKDP-6083-2995 › |
| 2026-09-02 01:03:38.187 · INFO · cbg-trade · test |
| [random_push_review.go:194] role get random push review, token: OFEC-HKDP-6083-2995 › |
| 2026-09-02 01:03:37.117 · INFO · cbg-cookie-pool · test |
| [cookiepool.go:162] update cookie success, id: 124, server: http://192.168.101.6:5000, account: fp494259@163.com, password: Aqwe1122, roleid: 42849119, proxy: http://lvuq16z3:lvuq16z3@116.136.200.122:2081 › |
| 2026-09-02 01:03:36.248 · INFO · cbg-item · test |
| [cache.go:351] flush status update batch table=pet_5 size=500 › |
| 2026-09-02 01:03:36.247 · INFO · cbg-item · test |
| [cache.go:312] status update cache clickhouse batch updated table=pet_5 batch_size=500 first_eid=202403262200113-84-22GPQ1CRD0XKH last_eid=202608111000113-55-6AJTDX6BQA7SY › |
| 2026-09-02 01:03:35.811 · INFO · cbg-trade · test |
| [report.go:167] ========== RandomDraw 汇总与性能分析报告 ========== 结果: success_with_errors 总耗时: 31.536s 停止原因: checkpoint 账号: vpf7130612@163.com (ID=110), 代理ID: 15 页面: 尝试 10 / 成功 10 / 失败 0 数据: 处理 146 / 新增 106 / 重复 40 / 时间过滤 0 / 归档 107 Mailbox: 成功 55 / 失败 106 吞吐量: 4.63 items/s, 0.32 pages/s 异常: 请求 0 / 解析 0 / 状态异常 0 / 密保 0 / 无代理 0 / 致命 0 最后错误: mailbox Mailbox:RoleFlow is full (size: 100000) 阶段耗时: - 数据库表检查: 1.590s - 获取Cookie: 0.001s - 加载抓取配置: 0.224s - 分页抓取: 27.109s - 历史归档: 0.237s - 保存Checkpoint: 0.161s - 保存运行统计: 0.233s - 发送通知与更新资源统计: 1.981s 调用统计: - Mailbox写入: 161次, 累计 1.657s, 平均 0.010s, P50 0.009s, P95 0.020s, P99 0.022s, 最大 0.039s - 代理获取: 10次, 累计 1.025s, 平均 0.102s, P50 0.000s, P95 0.000s, P99 0.000s, 最大 1.025s - 分页随机等待: 10次, 累计 14.877s, 平均 1.488s, P50 1.546s, P95 1.966s, P99 1.966s, 最大 1.976s - 响应JSON解析: 10次, 累计 0.019s, 平均 0.002s, P50 0.002s, P95 0.002s, P99 0.002s, 最大 0.004s - 响应读取: 10次, 累计 0.165s, 平均 0.016s, P50 0.007s, P95 0.045s, P99 0.045s, 最大 0.055s - 批量写入: 10次, 累计 1.160s, 平均 0.116s, P50 0.114s, P95 0.123s, P99 0.123s, 最大 0.125s - 批量去重查询: 10次, 累计 0.549s, 平均 0.055s, P50 0.054s, P95 0.056s, P99 0.056s, 最大 0.063s - 藏宝阁HTTP请求: 10次, 累计 6.043s, 平均 0.604s, P50 0.601s, P95 0.635s, P99 0.635s, 最大 0.636s 最慢页面 Top 10: - page=3, 总耗时=3.265s, 获取=2.611s, 处理=0.654s - page=1, 总耗时=3.122s, 获取=2.496s, 处理=0.626s - page=7, 总耗时=3.078s, 获取=2.552s, 处理=0.526s - page=2, 总耗时=2.996s, 获取=2.455s, 处理=0.541s - page=4, 总耗时=2.995s, 获取=2.551s, 处理=0.445s - page=8, 总耗时=2.910s, 获取=2.449s, 处理=0.460s - page=6, 总耗时=2.629s, 获取=2.176s, 处理=0.453s - page=10, 总耗时=2.243s, 获取=1.937s, 处理=0.306s - page=9, 总耗时=1.976s, 获取=1.510s, 处理=0.466s - page=5, 总耗时=1.868s, 获取=1.393s, 处理=0.475s ================================================== › |