All issues

Search results

Add a command to output response headers

Status: Open.

#159 In Qianlitp/crawlergo;

· harfe11 opened on Oct 26, 2025

使用--push-to-proxy无法获取数据包

Status: Open.

#156 In Qianlitp/crawlergo;

· dkive opened on Apr 1, 2024

设置了post请求的post-data，实际请求并没有发以post-data为body的post请求

Status: Open.

#155 In Qianlitp/crawlergo;

· dimsoul opened on Mar 11, 2024

Request: Change default to not submit forms to prevent accidental spam

featureNew feature or requestNew feature or request

Status: Open.

#154 In Qianlitp/crawlergo;

· MarkRosemaker opened on Jan 28, 2024

是否可以添加参数类似--url-keywords，只爬取包含特定关键字的url

Status: Open.

#153 In Qianlitp/crawlergo;

· tdragon6 opened on Jan 3, 2024

--ignore-url-keywords参数不管用和需求fuzz payload

bugSomething isn't workingSomething isn't working

Status: Open.

#152 In Qianlitp/crawlergo;

· Tian866 opened on Dec 22, 2023

Duplicate Requests

Status: Open.

#144 In Qianlitp/crawlergo;

· redkit75 opened on Apr 18, 2023

增加sitemap.xml(网站地图)解析功能，其读取主要和robots.txt差不多

featureNew feature or requestNew feature or request

Status: Open.

#143 In Qianlitp/crawlergo;

· sairson opened on Mar 17, 2023

OpenAPI Support

featureNew feature or requestNew feature or request

Status: Open.

#138 In Qianlitp/crawlergo;

· redkit75 opened on Jan 21, 2023

表格自动填写

discuss

Status: Open.

#131 In Qianlitp/crawlergo;

· byposeidon opened on Dec 13, 2022

Any suggestions on authenticated crawling?

featureNew feature or requestNew feature or request

Status: Open.

#126 In Qianlitp/crawlergo;

· rohitcoder opened on Nov 22, 2022

输出的json不合法

bugSomething isn't workingSomething isn't working

Status: Open.

#124 In Qianlitp/crawlergo;

· ox1234 opened on Oct 14, 2022