Skip to content

bugfix: Kill compile processes that generates too much output #2883

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

cmaglie
Copy link
Member

@cmaglie cmaglie commented Apr 10, 2025

Please check if the PR fulfills these requirements

See how to contribute

  • The PR has no duplicates (please search among the Pull Requests
    before creating one)
  • The PR follows
    our contributing guidelines
  • Tests for the changes have been added (for bug fixes / features)
  • Docs have been added / updated (for bug fixes / features)
  • UPGRADING.md has been updated with a migration guide (for breaking changes)
  • configuration.schema.json updated if new parameters are added.

What kind of change does this PR introduce?

Previously, compiling a sketch containing an include loop could generate a lot of output and crash the Arduino CLI with an out-of-memory error. This is due to the library-discovery process that buffers the stderr output of the compiler for analysis after the process exits.

To fix this problem, a limit to the compiler output has been set to 100KB of data.

What is the current behavior?

$ cat sketch.ino
#include <a.h>
$ cat a.h
#include <a.h>
#include <a.h>
#include <a.h>
$ arduino-cli compile -b arduino:avr:uno

The process never terminates, and it's killed for OOM later by the kernel.

What is the new behavior?

$ cat sketch.ino
#include <a.h>
$ cat a.h
#include <a.h>
#include <a.h>
#include <a.h>
$ arduino-cli compile -b arduino:avr:uno
[...a lot of output truncated...]
In file included from /home/cmaglie/sketch/a.h:1:0,
                 from /home/cmaglie/sketch/a.h:2,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:2,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/a.h:1,
                 from /home/cmaglie/sketch/sketch.ino:1:
/home/cmaglie/sketch/a.h:1:15: error: #include nested too deeply
/home/cmaglie/sketch/a.h:2:15: error: #include nested too deeply
Compiler error output has been truncated.

Used platform Version Path
arduino:avr   1.6.22  /home/cmaglie/.arduino15/packages/arduino/hardware/avr/1.6.22
Error during build: signal: killed
$

Does this PR introduce a breaking change, and is titled accordingly?

A legitimate sketch may produce a lot of warnings from a single file, going over 100KB. In that extreme case, the sketch could not be compiled anymore with Arduino CLI.

100KB looks like a reasonable limit. By the way, there are no specific stats available about this, so we have to deploy this fix, get feedback from the user, and be ready to increase this limit if needed.

Other information

@cmaglie cmaglie self-assigned this Apr 10, 2025
@cmaglie cmaglie added type: enhancement Proposed improvement topic: CLI Related to the command line interface labels Apr 10, 2025
@cmaglie cmaglie requested a review from a team April 10, 2025 16:08
Comment on lines +93 to +94
cancel()
fmt.Fprintln(stderr, i18n.Tr("Compiler error output has been truncated."))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
cancel()
fmt.Fprintln(stderr, i18n.Tr("Compiler error output has been truncated."))
fmt.Fprintln(stderr, i18n.Tr("Compiler error output has been truncated."))
cancel()

Probably I'd swap just in case the context cancellation unblocks the WaitWithinContext and returns the stderr bytes, before we appended the error string.

@cmaglie cmaglie force-pushed the unbound-recursion branch from a9e78c2 to 5d085c9 Compare April 28, 2025 15:41
@cmaglie cmaglie force-pushed the unbound-recursion branch 2 times, most recently from db92bd5 to 1b77a2b Compare April 28, 2025 21:03
This patch fixes how process are killed on MacOS and Windows
@cmaglie cmaglie force-pushed the unbound-recursion branch from 1b77a2b to 48d4e84 Compare April 29, 2025 17:34
Copy link

codecov bot commented Apr 29, 2025

Codecov Report

Attention: Patch coverage is 89.28571% with 3 lines in your changes missing coverage. Please review.

Project coverage is 67.84%. Comparing base (a6db55f) to head (48d4e84).
Report is 3 commits behind head on master.

Files with missing lines Patch % Lines
...ernal/arduino/builder/internal/preprocessor/gcc.go 89.28% 2 Missing and 1 partial ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##           master    #2883   +/-   ##
=======================================
  Coverage   67.83%   67.84%           
=======================================
  Files         238      238           
  Lines       22419    22442   +23     
=======================================
+ Hits        15209    15226   +17     
- Misses       6010     6014    +4     
- Partials     1200     1202    +2     
Flag Coverage Δ
unit 67.84% <89.28%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
topic: CLI Related to the command line interface type: enhancement Proposed improvement
2 participants