SeBS v1.2

What's Changed

• Rename docker directory and resolve linting issues by @mcopik in #112
• Add local memory measurement. by @skehrli in #102
• Fix shutdown and handling of memory measurement by @mcopik in #136
• Fix nits in OpenWhisk minio documentation by @alevy in #139
• Colored output (issues #65) by @lawrence910426 in #141
• Fix broken links in README.md by @mcopik in #160
• Fix #111 - incorrect igraph version by @mcopik in #113
• Support PyTorch benchmark for Python 3.8 and 3.9 on Lambda by @mcopik in #165
• Update AWS support for Node.js by @mcopik in #166
• Fixing typos in documentation by @nurSaadat in #175
• Improve handling of cloud credentials and account identification by @mcopik in #181
• [docs] Update benchmarks.md by @mcopik in #182
• Document adding new benchmark languages by @mcopik in #183
• Fix #188 - update README with OS requirements by @mcopik in #190
• Fix to #191 Update benchmarks.md by @mcopik in #193
• Implement a single-bucket design. by @mcopik in #186
• Fix storage connection timeout on non linux platforms by @Kaleab-git in #197
• updated support for benchmark language versions by @octonawish-akcodes in #198
• Updated local instructions by @aidentothe in #210
• Implement Dynamic Port Mapping for Function Containers for Local Deployment by @Kaleab-git in #199
• Minor updates to PR #199 by @mcopik in #226
• Add Multi-Architecture Support (x86_64, arm64) for Benchmarks by @mcopik in #227
• Container support for AWS by @prajinkhadka in #205
• Fix Local Deployment Invocation by @MahadMuhammad in #231
• Add versioning and resource_id to function names(#230) by @ojninja16 in #232
• Update linting process and repair CI by @mcopik in #241
• Add interface for NoSQL storage by @mcopik in #214
• Fix documentation and the blocking bugs for local backend by @rabbull in #249
• Fix invocation overhead experiment by @qdelamea-aneo in #240
• Add our user agent to 120.uploader by @mcopik in #255
• Minor Bug Fixes on GCP by @rabbull in #252
• [aws] Add support for benchmarks in cpp by @HoriaMercan in #251
• [AWS] Minor bug fixes by @DJAntivenom in #264
• fix: quote init.sh variables and add curl fallback for wget by @userlaurin in #287
• Add support for C++ benchmarks. by @mcopik in #99
• Improve SeBS documentation by @mcopik in #244
• Java benchmarks support by @mahlashrifi in #223
• New CLI options by @mcopik in #243
• Fix spelling typos across codebase by @joshuaswanson in #291
• Improvements to C++ benchmarks by @mcopik in #293

New Contributors

• @skehrli made their first contribution in #102
• @alevy made their first contribution in #139
• @lawrence910426 made their first contribution in #141
• @nurSaadat made their first contribution in #175
• @Kaleab-git made their first contribution in #197
• @octonawish-akcodes made their first contribution in #198
• @prajinkhadka made their first contribution in #205
• @MahadMuhammad made their first contribution in #231
• @ojninja16 made their first contribution in #232
• @rabbull made their first contribution in #249
• @qdelamea-aneo made their first contribution in #240
• @HoriaMercan made their first contribution in #251
• @DJAntivenom made their first contribution in #264
• @userlaurin made their first contribution in #287
• @mahlashrifi made their first contribution in #223
• @joshuaswanson made their first contribution in #291

Full Changelog: v1.1...v1.2

SeBS v1.1

Contributions

Many thanks to Paweł Żuk of the University of Warsaw for contributing OpenWhisk support!

We would like to also thank Laurin Brandner of ETH Zurich for bug fixes and for helping with testing the new release.

What changed?

• New system of handling non-root containers that do not require rebuilding Docker images.
• Deprecate Python 3.6 on all platforms.
• Update documentation and tutorials.
• Update benchmark codes and dependencies
• Many bug fixes.

OpenWhisk

• Support for the open-source FaaS platform OpenWhisk.
• OpenWhisk uses the new feature of deploying benchmarks as Docker images.
• We support Python 3.7 and 3.9, Node.js 10, and 12 functions.

AWS

• AWS Lambda functions now support Python 3.9 and Node.js 14. Python 3.6 and Node.js 8 are no longer supported.
• Docker build images for AWS now use official AWS images.
• Support for function states on AWS.

Other platforms

• Azure Functions support now Python 3.8 and Python 3.9, and Node.js 12 and 14. Python 3.6, Node.js 8, and 10 are no longer supported.
• Google Cloud Functions support now Node 12 and 14. Node 6 and 8 are no longer supported.

v1.0

The first release comes with full support for AWS Lambda, Azure Functions, and Google Cloud Functions.

Features

• Automatic build and deployment of serverless benchmarks to the cloud.
• Interface for automatic invocations with HTTP and library triggers.
• Experiments for evaluation of performance, cost, and invocation overheads.
• Python and NodeJS nchmarks are configurable with inputs of different sizes.

See our README for details on how to use SeBS.