Skip to content

A PR for testing performance benchmark report#2592

Closed
liquidsec wants to merge 5 commits intodevfrom
benchmark-fakebad
Closed

A PR for testing performance benchmark report#2592
liquidsec wants to merge 5 commits intodevfrom
benchmark-fakebad

Conversation

@liquidsec
Copy link
Copy Markdown
Contributor

@liquidsec liquidsec commented Aug 14, 2025

never merge this

@liquidsec liquidsec marked this pull request as draft August 14, 2025 22:28
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 15, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 15, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 15, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 15, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 15, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 22, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 22, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 22, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 22, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 22, 2025
@blacklanternsecurity blacklanternsecurity deleted a comment from github-actions Bot Aug 22, 2025
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Aug 22, 2025

📊 Performance Benchmark Report

Comparing benchmark-tests (baseline) vs benchmark-fakebad (current)

📈 Detailed Results (All Benchmarks)

📋 Complete results for all benchmarks - includes both significant and insignificant changes

🧪 Test Name 📏 Base 📏 Current 📈 Change 🎯 Status
Bloom Filter Dns Mutation Tracking Performance 8.16ms 175.84ms +2053.6% 🔴🔴🔴 ⚠️
Bloom Filter Large Scale Dns Brute Force 36.53ms 1.269s +3374.5% 🔴🔴🔴 ⚠️
Large Closest Match Lookup 352.65ms 357.05ms +1.2%
Realistic Closest Match Workload 192.48ms 196.66ms +2.2%
Event Validation Full Scan Startup Small Batch 436.46ms 463.57ms +6.2%
Event Validation Full Scan Startup Large Batch 785.57ms 803.34ms +2.3%
Make Event Autodetection Small 31.67ms 31.21ms -1.5%
Make Event Autodetection Large 320.26ms 313.67ms -2.1%
Make Event Explicit Types 14.04ms 13.91ms -0.9%
Excavate Single Thread Small 4.104s 4.053s -1.2%
Excavate Single Thread Large 9.427s 9.492s +0.7%
Excavate Parallel Tasks Small 4.214s 4.214s +0.0%
Excavate Parallel Tasks Large 7.261s 7.221s -0.5%
Is Ip Performance 3.13ms 3.21ms +2.6%
Make Ip Type Performance 11.30ms 11.32ms +0.2%
Mixed Ip Operations 4.48ms 4.49ms +0.2%
Typical Queue Shuffle 63.68µs 64.51µs +1.3%
Priority Queue Shuffle 703.61µs 714.68µs +1.6%

🎯 Performance Summary

! 2 regressions ⚠️
  16 unchanged ✅

🔍 Significant Changes (>10%)

  • Bloom Filter Dns Mutation Tracking Performance: 2053.6% 🐌 slower
  • Bloom Filter Large Scale Dns Brute Force: 3374.5% 🐌 slower

🐍 Python Version 3.11.13

Base automatically changed from benchmark-tests to dev September 4, 2025 15:34
@liquidsec
Copy link
Copy Markdown
Contributor Author

this is no longer needed.

@liquidsec liquidsec closed this Sep 4, 2025
@liquidsec liquidsec deleted the benchmark-fakebad branch September 4, 2025 15:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant