Jekyll2026-01-09T17:59:12+00:00/Backtrace - Release NotesA summary of the latest releases from the Backtrace team.backtrace-coronerd 1.62.702025-04-18T12:00:00+00:002025-04-18T12:00:00+00:00/coronerd/2025/04/18/coronerd-1.62.70<p>This release is recommended for all users.</p> <h1 id="improvements">Improvements</h1> <ul> <li>Adds a _has_guessed_frame attribute populated when one or more frames in the call stack were unwound to by some heuristic.</li> </ul>This release is recommended for all users.backtrace-coronerd 1.62.692025-02-24T12:00:00+00:002025-02-24T12:00:00+00:00/coronerd/2025/02/24/coronerd-1.62.69<p>This release is recommended for all users.</p> <h1 id="improvements">Improvements</h1> <ul> <li> <p>Fixed an issue where a sampling policy could cause a retention policy to stop running until restart.</p> </li> <li> <p>Fixed populating empty pages of CRDBs when objects are deleted.</p> </li> <li> <p>Fixed a crash when processing the <code class="highlighter-rouge">tail</code> aggregate on an empty derived attribute.</p> </li> <li> <p>Stricter hostname validation for incoming requests against a regular expression set in coronerd.conf’s <code class="highlighter-rouge">.httpd.valid_hostname</code>. The default is to not validate hostnames.</p> </li> <li> <p>Security improvements to frontend parameter validation.</p> </li> <li> <p>Increased object attribute limit in multipart uploads of error reports to 256 attributes from 128.</p> </li> <li> <p>Allow “.map” as sourcemap extension in symbol_extractor.</p> </li> <li> <p>Fixed guest access to various configuration elements.</p> </li> <li> <p>Fixed crashes in certain DWARF elements.</p> </li> <li> <p>Fixed bug in sourcemap deobfuscation using <code class="highlighter-rouge">library</code> rather than <code class="highlighter-rouge">path</code>. This bug was introduced in 1.61 and only affected the debugger view, and not fingerprints themselves.</p> </li> <li> <p>Support running coronerd with gimli or coresnapd for tracing crashes. The default is to retain gimli.</p> </li> <li> <p>Fixed minor inconsistencies in sampling and the sampling status output.</p> </li> <li> <p>Add several iOS libraries and frameworks to the minidump ignore rules. This may change existing fingerprints if reprocessing.</p> </li> <li> <p>Fix ingesting json-format errors with boolean attributes.</p> </li> <li> <p>dump_syms_mac: Optimize conversion time by up to 50% for large archives.</p> </li> <li> <p>Improve edge cases in C++ demangling.</p> </li> <li> <p>Fix inline function rendering when marshalling json-format error reports.</p> </li> <li> <p>Improve cleanup of unmapped symbol files.</p> </li> <li> <p>Several security improvements to fix information leaks.</p> </li> <li> <p>Several improvements to module and missing symbol handling.</p> </li> <li> <p>Improvements to sourcemap/proguard deobfuscation support.</p> </li> <li> <p>Add ability to generate missing symbol events for sourcemap and proguard deobfuscation files, to support symbold automatically downloading from appropriately configured symbol servers.</p> </li> <li> <p>Support adding security headers to HTTP responses from coronerd.conf.</p> </li> <li> <p>Fix watchdog timeouts from excessively large deletion requests.</p> </li> <li> <p>Apply /api/login rate limiting to /api/reset.</p> </li> </ul> <h1 id="other-changes">Other changes</h1> <ul> <li>This release adds the following distros to the supported list: <ul> <li>Ubuntu 24.04 (Noble Numbat)</li> </ul> </li> <li>This release drops the following distros from the supported list: <ul> <li>el/7, CentOS 7: due to June 2024 EOL</li> </ul> </li> <li> <p>The backtrace-coronerd-workflow package has been deprecated and is be replaced by backtrace-workflow &gt; 2.0. The latter implements a standalone service to manage workflows.</p> <ul> <li> <p>Not all workflows implemented by backtrace-coronerd-workflow are implemented by backtrace-workflow; see the release notes of the latter for details.</p> </li> <li> <p>coronerd 1.61 releases also support backtrace-workflows.</p> </li> </ul> </li> <li> <p>Issue states will no longer be automatically transitioned by coronerd. In particular, issues are no longer created in in-progress state. Issue state is instead managed by the backtrace-workflows service.</p> </li> <li> <p>The scheduled reports implementation has been moved from coronerd to a new backtrace-scheduled-reports service.</p> <ul> <li>coronerd 1.61 releases also support backtrace-scheduled-reports.</li> </ul> </li> <li> <p>Removed support for the <code class="highlighter-rouge">_mod_log</code> query parameter when submitting objects to coronerd. A detailed callstack log can be retrieved through the existing /api/callback endpoint instead.</p> </li> <li> <p>Removed support for synchronous delete in <code class="highlighter-rouge">/api/delete</code>.</p> </li> <li> <p>Removed support for missing symbol jlog journals and associated configuration items related to symbold: <code class="highlighter-rouge">.symbold.json_enable</code>, <code class="highlighter-rouge">.symbold.flush_frequency</code>, and <code class="highlighter-rouge">.symbold.max_journal_entries</code>. The functionality is implemented by missing symbol events instead.</p> </li> <li>(Experimental) Support throttling compression. A new feature flag <code class="highlighter-rouge">object:throttle_compression</code> can be enabled to throttle compression on busy hosts. This is configurable by setting <code class="highlighter-rouge">.compresion.throttle_time_ms</code> (default 10ms) and <code class="highlighter-rouge">.compression.throttle_num_blocks</code> (default 128 blocks) in coronerd.conf. This feature is slated to be removed in 1.63.</li> </ul>This release is recommended for all users.backtrace-ptrace 1.33.372025-02-22T03:11:41+00:002025-02-22T03:11:41+00:00/ptrace/2025/02/22/ptrace-1.33.37<p>This release includes support for Ubuntu/noble.</p>This release includes support for Ubuntu/noble.backtrace-coronerd 1.61.1172024-11-20T12:00:00+00:002024-11-20T12:00:00+00:00/coronerd/2024/11/20/coronerd-1.61.117<p>This release is recommended for all users.</p> <h1 id="improvements">Improvements</h1> <ul> <li>Fixed a problem with symbol resolution when the symbol’s code identifier has leading zeros.</li> </ul> <h1 id="os-support">OS Support</h1> <ul> <li>Obsolete el/7 builds after upstream EOL in June 2024. Final el/7 binaries for coronerd have been included in this release to keep an upgrade path, but service packages no longer support it. Current OS support list is el/8, el/9, ubuntu/bionic, ubuntu/focal, ubuntu/jammy.</li> </ul>This release is recommended for all users.backtrace-ptrace 1.33.342024-08-12T05:11:25+00:002024-08-12T05:11:25+00:00/ptrace/2024/08/12/ptrace-1.33.34<p>This release is recommended for all users.</p> <ul> <li>Improved support for aranges in DWARF 4 and 5.</li> <li>Various bugs squashed.</li> </ul>This release is recommended for all users. Improved support for aranges in DWARF 4 and 5. Various bugs squashed.backtrace-coronerd 1.61.1152024-05-06T12:00:00+00:002024-05-06T12:00:00+00:00/coronerd/2024/05/06/coronerd-1.61.115<p>This release is recommended for all users.</p> <h1 id="improvements">Improvements</h1> <ul> <li>Fix startup time degradation introduced in 1.61.114 when loading projects with may compressed objects.</li> </ul>This release is recommended for all users.backtrace-coronerd 1.61.1142024-02-29T12:00:00+00:002024-02-29T12:00:00+00:00/coronerd/2024/02/29/coronerd-1.61.114<p>This release is recommended for all users.</p> <h1 id="features">Features</h1> <ul> <li>JSON resource forks that reference sourcemaps with embedded source content will now contain that source. The source code is presented in the debug view when available.</li> </ul> <h1 id="improvements">Improvements</h1> <ul> <li>Improve authentication for /api/issue so that it does not allow API tokens to access other projects in a universe</li> <li>Add <code class="highlighter-rouge">/api/issue_control/merge_fingerprints</code> and <code class="highlighter-rouge">/api/issue_control/unmerge_fingerprints</code> to handle issue merging and unmerging, as a replacement for old, soft-deprecated CRDB-based interfaces. <ul> <li>If you are using morgue or the Backtrace console, a Coronerd upgrade will use these automatically.</li> </ul> </li> <li>LL/SC support in CRDB has been removed.</li> <li>Add <code class="highlighter-rouge">/api/project/list_users</code> endpoint to list users in a project.</li> <li>Guests can no longer see other users via BPG.</li> <li>Fix many edge cases related to submission actions when attempting to add tags to errors.</li> <li>Make it possible to create reopen rules for <code class="highlighter-rouge">&gt;= some_version</code>, as well as <code class="highlighter-rouge">&gt; some_version</code>.</li> <li><code class="highlighter-rouge">/api/bpg</code> now validates that <code class="highlighter-rouge">Content-Type: application/json</code> is set.</li> <li>Fix caching of the <code class="highlighter-rouge">truncate_timestamp</code> virtual column, accelerating queries used in stability score.</li> <li>Universe names for new universes must now be under 64 characters.</li> <li>Fixed crash in PDB conversion when importing a PDB without no global records.</li> <li>No longer attempt to submit attachments for a sampled error report.</li> <li>Fixed symbol resolution in DIA SDK style errors.</li> <li>Fixed potential infinite loop when importing dSYM symbols containing zero line numbers.</li> <li>Improvements to sourcemap deobfuscation for more accurate line numbers.</li> <li>Added support for accepting archives of sourcemaps.</li> <li>dSYM symbols may now be imported alongside the executable without stripping the .dSYM extension.</li> <li>Symbol conversion can now be performed using <code class="highlighter-rouge">bt_symbols_convert</code> wrapper, which simplifies handling of all supported symbol formats, including auxiliary files.</li> <li>Symbol tags containing quotes are now handled properly.</li> <li><code class="highlighter-rouge">/api/get</code> now emits an <code class="highlighter-rouge">X-Object-Format</code> header which indicates the type of the returned object.</li> </ul>This release is recommended for all users.backtrace-ptrace 1.33.312024-01-10T15:44:43+00:002024-01-10T15:44:43+00:00/ptrace/2024/01/10/ptrace-1.33.31<p>This release is recommended for all users.</p> <ul> <li>Support for RedHat 9 and derivative distros.</li> <li>Support for ELF files with more than 65536 program headers.</li> <li>ptrace now takes –extra-attrs, which allows overriding attributes, including the faulting thread ID.</li> <li>Various bugs squashed.</li> </ul>This release is recommended for all users. Support for RedHat 9 and derivative distros. Support for ELF files with more than 65536 program headers. ptrace now takes –extra-attrs, which allows overriding attributes, including the faulting thread ID. Various bugs squashed.backtrace-ptrace 1.33.272023-08-29T21:04:32+00:002023-08-29T21:04:32+00:00/ptrace/2023/08/29/ptrace-1.33.27<p>This release is recommended for all users.</p> <ul> <li>Significantly improved support for DWARF5.</li> <li>Improved unwinding for frames with missing symbols.</li> <li>Various bugs squashed.</li> </ul>This release is recommended for all users. Significantly improved support for DWARF5. Improved unwinding for frames with missing symbols. Various bugs squashed.backtrace-coronerd 1.60.912023-07-27T12:00:00+00:002023-07-27T12:00:00+00:00/coronerd/2023/07/27/backtrace-coronerd-1.60.91<p>This release is recommended for all users.</p> <h1 id="features">Features</h1> <ul> <li> <p>A new scheme is used to store passwords, with bcrypt replacing the legacy scheme. Users are automatically migrated on first relogin after an upgrade. It is advisable to make a copy of <code class="highlighter-rouge">/etc/coronerd/coronerd.db</code> before the upgrading to this version to ease potential downgrades, because previous versions of <code class="highlighter-rouge">coronerd</code>, which don’t know about the new scheme, will refuse to start. Should a rollback be necessary, <code class="highlighter-rouge">coronerd.db</code> can be restored from the backup. Further assistance is available from Backtrace Technical Support.</p> </li> <li> <p>When sending emails for signup or password recovery, the generated link will now only use the hostname provided in the “Origin” or “Host” header if it matches the regex defined in the new coronerd.conf setting “httpd.valid_hostname”. If it doesn’t match, then the DNS name defined for the “httpd/console” listener will be used.</p> </li> <li> <p>A new built-in attribute, “device.model”, has been added for SDK use.</p> </li> <li> <p>New endpoints for symbol-processor support have been added. This release is required for pending improvements to symbold.</p> </li> <li> <p>Custom deduplication rules now support escapes such as <code class="highlighter-rouge">\d</code> and <code class="highlighter-rouge">\w</code>.</p> </li> <li> <p>Custom deduplication rules now support groups. A rule such as <code class="highlighter-rouge">s#whatever(\d+)#$1#G</code> will capture and replace. The suffix <code class="highlighter-rouge">G</code> enables this functionality, which gives <code class="highlighter-rouge">$</code> special meaning in the replacement. To write a <code class="highlighter-rouge">$</code> with groups enabled, use <code class="highlighter-rouge">$$</code>.</p> </li> <li> <p>The api/delete endpoint now supports a query argument which will delete any object that is matched by the query. It can delete physical data from disk, and optionally the additional metadata from the database.</p> </li> <li> <p>Requests to the api/login endpoint are now rate limited. By default it’s configured to ignore requests from 127.0.0.1, and any ip addresses you specifically whitelist. Requests are limited at a rate of 10 requests per minute per ip address.</p> </li> <li> <p>Re-enables el8 support via rockylinux8 instead of the now EOL centos8</p> </li> <li> <p>Added support for Ubuntu 22LTS</p> </li> </ul> <h1 id="improvements">Improvements</h1> <ul> <li> <p>It is now possible to have up to 256 submission actions per project.</p> </li> <li> <p>/api/config can now handle projects which contain more than UINT32_MAX errors.</p> </li> <li> <p>Fix reliability of symbol importing in certain cases.</p> </li> <li> <p>JSON error objects will now use the provided function name if symbolication fails.</p> </li> <li> <p>Fixed a problem where symbols files that are removed from disk were not evicted from an in-memory cache.</p> </li> <li> <p>Added support for PDBs generated when compiling with /Z7.</p> </li> <li> <p>Improved handling of minidumps containing large numbers of threads.</p> </li> <li> <p>Improved indexing of attributes. On the first start of coronerd 1.60 there may be some extra disk activity in the background while coronerd is reindexing attributes. This will also happen on downgrades to 1.59 from 1.60. Subsequent starts after reindexing has completed will be faster.</p> </li> <li> <p>Added support for large, 4+ GiB PDBs.</p> </li> <li> <p>Improved symbol import of dSYM and executable pairs.</p> </li> <li> <p>Conversion of dSYM symbols now includes inline function information.</p> </li> <li> <p>Improved handling of minidumps containing a large number of memory regions.</p> </li> <li> <p>Improved processing of truncated minidumps.</p> </li> <li> <p>Fixed handling of PE files generated by LLVM’s linker in symbol conversion.</p> </li> <li> <p>Improved call stack unwinding for crashes involving an invalid program counter in the exception context.</p> </li> <li> <p>Added support for compressed .debug_info sections when importing symbols from an ELF executable file.</p> </li> <li> <p>Fixed crash in PDB conversion when input filename did not contain a file extension.</p> </li> <li> <p>Fixed extraction of debug identifier when processing a minidump containing trailing data in a code view information record.</p> </li> <li> <p>Fixed processing of SYM files containing absolute paths to the source binary.</p> </li> <li> <p>Updated coronerd resource scripts to run under later versions of dash.</p> </li> </ul>This release is recommended for all users.