Skip to content

Dev-> 3.0 sync#3022

Open
liquidsec wants to merge 97 commits into3.0from
dev
Open

Dev-> 3.0 sync#3022
liquidsec wants to merge 97 commits into3.0from
dev

Conversation

@liquidsec
Copy link
Copy Markdown
Contributor

No description provided.

TheTechromancer and others added 23 commits January 2, 2026 15:34
Replace the single PR-author org membership check with a unified step
that iterates all committers on the PR and checks each against:
1. GitHub API account type (type == "Bot" for App accounts)
2. Org membership

Commits with no associated GitHub login are treated as non-exempt
(prevents bypass via spoofed email with no GitHub account).

Tested on aconite33/cla-workflow-test:
- Human committer: correctly required CLA
- github-actions[bot]: correctly skipped via API type check
Tested on aconite33/cla-workflow-test with only pull-requests:write
and statuses:write -- both human CLA and bot skip paths work correctly.
The CLA assistant uses PERSONAL_ACCESS_TOKEN (app token) for writing
signatures to the remote CLA repo, not GITHUB_TOKEN.
Fix CLA workflow to skip bots and check all committers
Merge stable into dev to resolve CLA workflow conflict
Merge dev into stable: CLA workflow update
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 8, 2026

📊 Performance Benchmark Report

Comparing 3.0 (baseline) vs dev (current)

📈 Detailed Results (All Benchmarks)

📋 Complete results for all benchmarks - includes both significant and insignificant changes

🧪 Test Name 📏 Base 📏 Current 📈 Change 🎯 Status
Bloom Filter Dns Mutation Tracking Performance 3.25ms 3.31ms +1.8%
Bloom Filter Large Scale Dns Brute Force 13.58ms 13.58ms +0.0%
Large Closest Match Lookup 254.40ms 256.31ms +0.8%
Realistic Closest Match Workload 139.78ms 138.30ms -1.1%
Event Memory Medium Scan 1782 B/event 1768 B/event -0.8%
Event Memory Large Scan 1768 B/event 1767 B/event -0.1%
Event Validation Full Scan Startup Small Batch 288.72ms 291.63ms +1.0%
Event Validation Full Scan Startup Large Batch 394.15ms 413.01ms +4.8%
Make Event Autodetection Small 19.42ms 19.52ms +0.5%
Make Event Autodetection Large 198.04ms 197.04ms -0.5%
Make Event Explicit Types 8.12ms 8.29ms +2.1%
Excavate Single Thread Small 2.658s 2.684s +1.0%
Excavate Single Thread Large 6.787s 6.787s -0.0%
Excavate Parallel Tasks Small 2.809s 2.845s +1.3%
Excavate Parallel Tasks Large 5.270s 5.306s +0.7%
Is Ip Performance 2.48ms 2.48ms -0.1%
Make Ip Type Performance 8.89ms 8.74ms -1.7%
Mixed Ip Operations 3.49ms 3.51ms +0.6%
Memory Use Web Crawl 46.1 MB 45.8 MB -0.7%
Memory Use Subdomain Enum 19.4 MB 19.5 MB +0.4%
Scan Throughput 100 8.208s 7.377s -10.1% 🟢🟢 🚀
Scan Throughput 1000 33.557s 31.594s -5.8%
Typical Queue Shuffle 45.68µs 46.95µs +2.8%
Priority Queue Shuffle 529.99µs 541.94µs +2.3%

🎯 Performance Summary

+ 1 improvement 🚀
  23 unchanged ✅

🔍 Significant Changes (>10%)

  • Scan Throughput 100: 10.1% 🚀 faster

🐍 Python Version 3.11.15

@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 8, 2026

Codecov Report

❌ Patch coverage is 87.66520% with 84 lines in your changes missing coverage. Please review.
✅ Project coverage is 91%. Comparing base (d8f056e) to head (64c2193).

Files with missing lines Patch % Lines
bbot/core/helpers/dns/dns.py 82% 41 Missing ⚠️
bbot/modules/paramminer_getparams.py 41% 16 Missing ⚠️
bbot/modules/paramminer_headers.py 54% 14 Missing ⚠️
bbot/scanner/target.py 45% 5 Missing ⚠️
bbot/modules/dnscaa.py 89% 3 Missing ⚠️
bbot/modules/baddns.py 67% 2 Missing ⚠️
bbot/__init__.py 67% 1 Missing ⚠️
bbot/modules/internal/cloudcheck.py 90% 1 Missing ⚠️
bbot/modules/internal/dnsresolve.py 94% 1 Missing ⚠️
Additional details and impacted files
@@          Coverage Diff           @@
##             3.0   #3022    +/-   ##
======================================
- Coverage     91%     91%    -0%     
======================================
  Files        440     440            
  Lines      37685   37560   -125     
======================================
- Hits       34104   33973   -131     
- Misses      3581    3587     +6     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

TheTechromancer and others added 5 commits April 15, 2026 14:29
- Update deps_pip and pyproject.toml to baddns~=2.1.0
- Pass self.scan.helpers.dns.blastdns as dns_client (was .resolver)
- Replace MODERATE confidence level with MEDIUM to match baddns 2.1.0
TheTechromancer and others added 13 commits April 24, 2026 16:20
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.10 to 0.15.12.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](astral-sh/ruff@0.15.10...0.15.12)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.12
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
headers: 1150 → 289 (-75%); removed pecl_http C constants, CGI env vars,
HTTP status reason phrases, PHP superglobals, Apache module names, WAP-era
device cruft, defunct platforms (BAE/FirePHP/Tomboy/Mosso/Prototype.js/
Hixie-76 WebSocket/RFC2965 Cookie2), per-app webhook signatures and CSRF
headers, and joke/typo/fragment entries.

parameters: 6514 → 5224 (-20%); removed case-insensitive duplicates,
numbered single-app dump residue (u1-u50, sql* series), pfSense WebGUI
form fields, SMF install fields, phpMyAdmin admin-form fields, phpBB
forum-specific entries, ID3 audio-tag tool entries, all 1- and 2-letter
entries, and 3-letter entries that aren't well-known abbreviations.
…/ruff-0.15.12

Bump ruff from 0.15.10 to 0.15.12
Updates the requirements on [pytest](https://github.com/pytest-dev/pytest) to permit the latest version.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](pytest-dev/pytest@8.3.1...9.0.3)

---
updated-dependencies:
- dependency-name: pytest
  dependency-version: 9.0.3
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Neo4j fix - serialize host_metadata
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026


Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.


I have read the CLA Document and I hereby sign the CLA


3 out of 8 committers have signed the CLA.
✅ (cnnrshd)[https://github.com/cnnrshd]
✅ (TrebledJ)[https://github.com/TrebledJ]
✅ (ChrisJr404)[https://github.com/ChrisJr404]
@TheTechromancer
@liquidsec
@aconite33
@ausmaster
@blsaccess
You can retrigger this bot by commenting recheck in this Pull Request. Posted by the CLA Assistant Lite bot.

TheTechromancer and others added 2 commits May 1, 2026 10:30
enhancement: in fingerprintx, emit `URL_UNVERIFIED` event upon detecting http protocols
inspect.getsource(cls) relies on linecache heuristics that mis-anchor
on Python 3.13+ and can return a single indented attribute line, which
ast.parse rejects with IndentationError. Read the whole source file
instead — each baddns submodule is one class per file.
@ausmaster
Copy link
Copy Markdown
Contributor

recheck

TheTechromancer and others added 13 commits May 1, 2026 12:30
fix(test): parse baddns submodule source from file (Py 3.13+ fix)
The url_full YARA rule and the full_url_regex / full_url_regex_strict
post-filters all required hosts to be word-character labels, so URLs
with bracketed IPv6 hosts (http://[2001:db8::1]/, http://[::1]:8080/...)
were dropped at extraction time. Add a [0-9a-fA-F:]+ alternative to the
host part of all three patterns so IPv6 URLs are emitted as
URL_UNVERIFIED events alongside DNS-name URLs.

Adds bbot/test/test_step_1/test_excavate_url_regexes.py — 6 cases that
pin both the new IPv6 acceptance and a regression guard for the
existing DNS-name / IPv4 URLs.

Closes #1815
Adds linktr.ee profile detection to the existing social module, alongside
LinkedIn / GitHub / Discord / etc. The username pattern is the
3-30 character window of [a-zA-Z0-9._] that Linktree uses on its
sign-up page.

Extends test_module_social.TestSocial with a Linktree fixture and
asserts both the canonical url and profile_name fields on the emitted
SOCIAL event.

Closes #2399
Closes #1876.

Hetzner offers S3-compatible Object Storage at three locations (Falkenstein
fsn1, Nuremberg nbg1, Helsinki hel1), addressed at
https://<bucket>.<location>.your-objectstorage.com/. cloudcheck already
ships a Hetzner provider, so this just plugs a new bucket_hetzner module
into the existing bucket_template:

- regions = ['fsn1', 'nbg1', 'hel1'] - all three Object Storage locations
  documented at https://docs.hetzner.com/storage/object-storage/overview/
- base_domains = ['your-objectstorage.com']
- supports_open_check = True (S3 list-bucket protocol)

Adds a focused smoke test verifying the module wires up to the cloudcheck
Hetzner provider and emits the documented URL shape. The shared
Bucket_Amazon_Base inherited test pattern depends on the cloudcheck regex
capturing bucket + host as separate groups, but Hetzner's current
cloudcheck regex matches <bucket>.your-objectstorage.com without a region
segment - so the smoke-test layout is used here until the cloudcheck
regex is region-aware.
…/pytest-gte-8.3.1-and-lt-10

Update pytest requirement from <9,>=8.3.1 to >=8.3.1,<10
Updates the requirements on [uvicorn](https://github.com/Kludex/uvicorn) to permit the latest version.
- [Release notes](https://github.com/Kludex/uvicorn/releases)
- [Changelog](https://github.com/Kludex/uvicorn/blob/main/docs/release-notes.md)
- [Commits](Kludex/uvicorn@0.32.0...0.46.0)

---
updated-dependencies:
- dependency-name: uvicorn
  dependency-version: 0.46.0
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Add Hetzner Object Storage bucket-cataloger module (#1876)
…/uvicorn-gte-0.32-and-lt-0.47

Update uvicorn requirement from <0.40,>=0.32 to >=0.32,<0.47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants