Skip to content

test(ffe/ruby): enable agentless configuration tests - #7733

Open
pavlokhrebto wants to merge 3 commits into
pavlo.khrebto/FFLSDK-10/ruby-ffe-adapter-compatibilityfrom
pavlo.khrebto/FFLSDK-10/ruby-agentless-test-enablement
Open

pavlokhrebto wants to merge 3 commits into
pavlo.khrebto/FFLSDK-10/ruby-ffe-adapter-compatibilityfrom
pavlo.khrebto/FFLSDK-10/ruby-agentless-test-enablement

Conversation

@pavlokhrebto

@pavlokhrebto pavlokhrebto commented Sep 15, 2026 •

Copy link
Copy Markdown
Contributor

Motivation

Ruby agentless configuration delivery needs the shared configuration-source and end-to-end coverage enabled for the release containing the implementation.

Changes and Decisions

Enable the Ruby configuration-source parametric suite and agentless configuration scenario from v2.44.0-dev. Earlier releases remain excluded because the provider activation stack landed after v2.43.0.

This PR contains only two entries in the Ruby manifest and is based on the adapter compatibility change in #7731. Land that prerequisite first, then retarget this PR to main and validate the enablement against the Ruby build containing the feature.

@linear-code

linear-code Bot commented Sep 15, 2026

Copy link
Copy Markdown

FFLSDK-10

@pavlokhrebto pavlokhrebto changed the title test(ffe/ruby): enable agentless configuration-source coverage test(ffe/ruby): enable agentless configuration tests Sep 15, 2026
@github-actions

github-actions Bot commented Sep 15, 2026 •

Copy link
Copy Markdown
Contributor

CODEOWNERS have been resolved as:

manifests/ruby.yml                                                      @DataDog/system-tests-reviewers

@datadog-datadog-prod-us1-2

datadog-datadog-prod-us1-2 Bot commented Sep 15, 2026 •

Copy link
Copy Markdown

Pipelines  Tests

✨ Unblock PR with BitsAI

❌ Errors

Your PR has failed checks. Please review the issues below and take necessary action before merging.

🚦 14 Pipeline jobs failed

Testing the test | System Tests (ruby, dev) / End-to-end #1 / rack 1 — ❌ 1 test failed · 🔧 Needs a code fix, caused by this PR

View more details · View in GitHub Actions

❌ tests.ffe.test_agentless_configuration.Test_FFE_Agentless_Configuration.test_default_agentless_source[rack] from system_tests_suite
AssertionError: Flag evaluation failed: not found
assert 404 == 200
 +  where 404 = HttpResponse(status_code:404, headers:{'Content-Type': 'text/plain', 'Content-Length': '9'}, text:not found).status_code
 +    where HttpResponse(status_code:404, headers:{'Content-Type': 'text/plain', 'Content-Length': '9'}, text:not found) = <tests.ffe.test_agentless_configuration.Test_FFE_Agentless_Configuration object at 0x7f81e82c1040>.response

self = <tests.ffe.test_agentless_configuration.Test_FFE_Agentless_Configuration object at 0x7f81e82c1040>

    def test_default_agentless_source(self) -> None:
>       assert self.response.status_code == 200, f"Flag evaluation failed: {self.response.text}"
E       AssertionError: Flag evaluation failed: not found
...
Testing the test | System Tests (ruby, dev) / End-to-end #1 / rails52 1 — ❌ 1 test failed · 🔧 Needs a code fix, caused by this PR

View more details · View in GitHub Actions

❌ tests.ffe.test_agentless_configuration.Test_FFE_Agentless_Configuration.test_default_agentless_source[rails52] from system_tests_suite
     line-height: 1.5em;
    }
  
    .rails-default-error-page div.dialog > p {
      margin: 0 0 1em;
      padding: 1em;
      background-color: #F7F7F7;
      border: 1px solid #CCC;
      border-right-color: #999;
      border-left-color: #999;
...
Testing the test | System Tests (ruby, dev) / End-to-end #1 / rails61 1 — ❌ 1 test failed · 🔧 Needs a code fix, caused by this PR

View more details · View in GitHub Actions

❌ tests.ffe.test_agentless_configuration.Test_FFE_Agentless_Configuration.test_default_agentless_source[rails61] from system_tests_suite
     line-height: 1.5em;
    }
  
    .rails-default-error-page div.dialog > p {
      margin: 0 0 1em;
      padding: 1em;
      background-color: #F7F7F7;
      border: 1px solid #CCC;
      border-right-color: #999;
      border-left-color: #999;
...

View all 14 failed jobs.

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 404bb86 | Docs | View more details | Give us feedback!

…ebto/FFLSDK-10/ruby-agentless-test-enablement
@leoromanovsky
leoromanovsky added this pull request to stack #7873 September 30, 2026 15:42
Keep the child PR limited to two Ruby manifest entries and gate them on v2.44.0-dev, the version containing provider activation.

Environment: Datadog workspace
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 30, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-09-30T17:10:24.309330Z 404bb86 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@leoromanovsky
leoromanovsky removed this pull request from stack #7873 October 1, 2026 20:15

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants