| 2026-10-11 12:17:03.622 · INFO · cbg-trade · test |
| [clickhouse.go:67] ClickHouse connected successfully, database=cbg_item host=192.168.101.203 port=9000 › |
| 2026-10-11 12:17:03.597 · INFO · cbg-trade · test |
| [database.go:732] mysql connection pool configured: MaxOpenConns=50, MaxIdleConns=10, ConnMaxLifetime=300s › |
| 2026-10-11 12:17:03.457 · INFO · cbg-trade · test |
| [database.go:694] mysql connecting to 124.220.31.60:3306/cbg as root › |
| 2026-10-11 12:17:03.430 · INFO · cbg-trade · test |
| [redis.go:41] Redis client initialized successfully › |
| 2026-10-11 12:17:03.414 · INFO · cbg-trade · test |
| [redis.go:34] Redis connecting to 192.168.101.203:6379, timeout: 30s › |
| 2026-10-11 12:17:03.413 · INFO · cbg-trade · test |
| [config.go:110] local ip [192.168.101.204 172.19.0.1 172.20.0.1 172.17.0.1 172.21.0.1 172.18.0.1] › |
| 2026-10-11 12:17:03.410 · INFO · cbg-trade · test |
| [main.go:30] Git Commit: revision -> [unknown] › |
| 2026-10-11 12:17:03.410 · INFO · cbg-trade · test |
| [main.go:37] Current directory: /app › |
| 2026-10-11 12:17:03.409 · INFO · cbg-trade · test |
| [main.go:29] Starting server, time -> [2026-10-11 12:17:03] › |
| 2026-10-11 12:17:01.951 · INFO · cbg-trade · test |
| [producer.go:173] [value-stats] producer buffer=0 sent=3881 dropped=10 › |
| 2026-10-11 12:16:56.997 · INFO · cbg-trade · test |
| [general_cookie.go:51] kill cookie response: {"code":0,"message":"success","data":{"id":133}} › |
| 2026-10-11 12:16:56.997 · INFO · cbg-trade · test |
| [main.go:59] Server exit, [1.89 minutes] elapsed › |
| 2026-10-11 12:16:56.902 · WARN · cbg-trade · test |
| [newitemflow.go:71] [itemflow][ylvp174242@163.com][proxy:http://trdw25w3:trdw25w3@182.40.44.5:1666] process count is zero, kill cookie, account_id: 133, role_id: 19187624 › |
| 2026-10-11 12:16:56.902 · INFO · cbg-trade · test |
| [general_cookie.go:49] kill cookie for config id: 133 › |
| 2026-10-11 12:16:55.733 · ERROR · cbg-trade · test |
| [spider.go:318] [itemflow][ylvp174242@163.com][proxy:http://trdw25w3:trdw25w3@182.40.44.5:1666] process item flow page failed: batch create sub flows: Error 1205 (HY000): Lock wait timeout exceeded; try restarting transaction › |
| 2026-10-11 12:16:51.685 · INFO · cbg-trade · test |
| [main.go:59] Server exit, [1.80 minutes] elapsed › |
| 2026-10-11 12:16:51.685 · INFO · cbg-trade · test |
| [report.go:167] ========== RandomDraw 汇总与性能分析报告 ========== 结果: success_with_errors 总耗时: 107.953s 停止原因: checkpoint 账号: hn2jds@163.com (ID=212), 代理ID: 5 页面: 尝试 22 / 成功 22 / 失败 0 数据: 处理 318 / 新增 170 / 重复 148 / 时间过滤 0 / 归档 186 Mailbox: 成功 66 / 失败 170 吞吐量: 2.95 items/s, 0.20 pages/s 异常: 请求 1 / 解析 0 / 状态异常 4 / 密保 4 / 无代理 0 / 致命 0 最后错误: mailbox Mailbox:RoleFlow is full (size: 100000) 阶段耗时: - 数据库表检查: 0.712s - 获取Cookie: 0.001s - 加载抓取配置: 0.086s - 分页抓取: 105.616s - 历史归档: 0.236s - 保存Checkpoint: 0.088s - 保存运行统计: 0.137s - 发送通知与更新资源统计: 1.076s 调用统计: - Mailbox写入: 236次, 累计 1.753s, 平均 0.007s, P50 0.006s, P95 0.015s, P99 0.021s, 最大 0.027s - 代理获取: 27次, 累计 2.037s, 平均 0.075s, P50 0.000s, P95 0.320s, P99 0.353s, 最大 0.432s - 分页随机等待: 27次, 累计 35.957s, 平均 1.332s, P50 1.443s, P95 1.867s, P99 1.890s, 最大 1.891s - 响应JSON解析: 26次, 累计 0.039s, 平均 0.002s, P50 0.002s, P95 0.002s, P99 0.002s, 最大 0.003s - 响应读取: 26次, 累计 1.830s, 平均 0.070s, P50 0.014s, P95 0.290s, P99 0.400s, 最大 0.411s - 批量写入: 19次, 累计 1.226s, 平均 0.065s, P50 0.064s, P95 0.066s, P99 0.066s, 最大 0.067s - 批量去重查询: 22次, 累计 0.545s, 平均 0.025s, P50 0.025s, P95 0.026s, P99 0.026s, 最大 0.027s - 藏宝阁HTTP请求: 27次, 累计 47.063s, 平均 1.743s, P50 1.073s, P95 2.605s, P99 2.828s, 最大 15.000s 最慢页面 Top 10: - page=8, 总耗时=27.229s, 获取=27.106s, 处理=0.123s - page=15, 总耗时=14.500s, 获取=14.265s, 处理=0.235s - page=20, 总耗时=9.624s, 获取=9.497s, 处理=0.127s - page=21, 总耗时=4.339s, 获取=4.142s, 处理=0.197s - page=3, 总耗时=3.967s, 获取=3.624s, 处理=0.343s - page=6, 总耗时=3.765s, 获取=3.463s, 处理=0.301s - page=14, 总耗时=3.292s, 获取=2.957s, 处理=0.335s - page=1, 总耗时=3.249s, 获取=2.920s, 处理=0.329s - page=17, 总耗时=3.220s, 获取=2.919s, 处理=0.301s - page=22, 总耗时=3.056s, 获取=3.012s, 处理=0.044s ================================================== › |
| 2026-10-11 12:16:49.302 · WARN · cbg-trade · test |
| [update_item.go:34] update item failed, eid: 202610110300113-138-XPTSQNNSEGBH, code: 1, message: item not found › |
| 2026-10-11 12:16:44.128 · WARN · cbg-trade · test |
| [update_item.go:34] update item failed, eid: 202607141600113-138-CDPEB2RY7RNY, code: 1, message: item not found › |
| 2026-10-11 12:16:42.541 · WARN · cbg-trade · test |
| [update_item.go:34] update item failed, eid: 202609222300113-138-BQFTSFWT2OKG, code: 1, message: item not found › |