wangshaoqing

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-06-08 10:41:15 +08:00

74a79cb1f4 Improve XHS long task downloads

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 19:02:07 +08:00

7944ac1f0c Save visible XHS comments by default

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 18:29:56 +08:00

dea08527eb Save metadata for downloaded XHS videos

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 17:57:04 +08:00

b13f170ce8 Use XHS video tab channel

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 17:35:33 +08:00

a43168d5a9 Filter search queue to video cards

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 16:49:51 +08:00

f247cb1a3a Add XHS keyword search source

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 16:30:07 +08:00

37b17d8ccf Add resumable XHS queue downloader

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 16:03:41 +08:00

ed8357f65a Add human browsing cadence

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 15:50:46 +08:00

d6e4443d40 Improve XHS batch pagination

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 15:36:24 +08:00

9788647ede Use shared Chrome debug port

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 15:29:25 +08:00

12c2009950 Add XHS explore batch download

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 15:11:45 +08:00

16f262ada1 Fix XHS video URL extraction

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 14:07:07 +08:00

3a2a6a69e0 Add XHS browser feed downloader

ec5d174bdc Add XHS downloader design and plan

Compare 2 commits »

wangshaoqing created branch main in wangshaoqing/xhs_video_crawler

2026-05-27 13:44:01 +08:00

wangshaoqing pushed to main at wangshaoqing/xhs_video_crawler

2026-05-27 13:44:01 +08:00

5ca45ecc8c Add project README

wangshaoqing created repository wangshaoqing/xhs_video_crawler

2026-05-27 10:52:42 +08:00

wangshaoqing pushed to main at wangshaoqing/douyin-crawler-poc

2026-05-26 16:18:46 +08:00

ca5fe9634a feat: add search result video crawling

wangshaoqing pushed to main at wangshaoqing/douyin-crawler-poc

2026-05-26 15:54:47 +08:00

cc1109628f fix: scroll recommendation feed container

wangshaoqing pushed to main at wangshaoqing/douyin-crawler-poc

2026-05-26 15:30:00 +08:00

d0f6c5e5ab feat: add human-like recommendation scrolling

wangshaoqing pushed to main at wangshaoqing/douyin-crawler-poc

2026-05-26 14:43:31 +08:00

452f14da69 feat: improve recommendation video URL extraction

4fb4131217 feat: add human-like random scrolling to avoid detection

Compare 2 commits »