Performance and usability enhancements, bug fixes, and CI/CD automation for Shuffle - #22

Open

imranakram wants to merge 46 commits into

feature/minorFixes

Commits on Apr 13, 2026

Improve import/export: batching, OptionSet, perf, CI/CD
imranakram
committed
e5ee20f
Avoiding Fluent style calls producing lots of `ToString()` noise in logs. Updated ShuffleDataImport.cs and ShuffleSolutionImport.cs to use formatted values where available, improving clarity during…
imranakram
committed
27a16e8
Remove System.IO.Compression.dll from nuspec package file because it's available natively
imranakram
committed
e7402f9
nuget owners update
imranakram
committed
6d2beea
Update README with full docs and schema reference
imranakram
committed
41edd09

Commits on Apr 15, 2026

Commits on Apr 16, 2026

Tighten Upsert path: require UpdateIdentical=true
imranakram
committed
46f83b3

Commits on Sep 8, 2026

Make the LCG output folder repo-relative
imranakram
committed
4786a5b
Do not count unexecuted batch requests as successes
imranakram
committed
4f9233d

Commits on Sep 9, 2026

Align the BatchSize schema default with the actual default
imranakram
committed
bdb5013
Bump NuGet.Protocol to 7.9.0
imranakram
committed
c4a1e5b
Let batching engage for blocks that use Match

imranakram
and
claude
committed
f746bc4
Give deferred state and owner changes the real record id

imranakram
and
claude
committed
091629f
Declare DeferStateAndOwner in the schema

imranakram
and
claude
committed
dacc328
Expose DeferStateAndOwner in the Shuffle Builder
imranakram
committed
c541dc9
Bring README and nuspec release notes in line with the code
imranakram
committed
18c6fb8
Add CLAUDE.md describing the build, layout and import strategy
imranakram
committed
13f1eca
Show real values instead of SDK type names in import log lines
imranakram
committed
8c49e63
Ignore DeferStateAndOwner for blocks that carry only state and owner
imranakram
committed
fb4194d
Report the row number when a record matches several targets

imranakram
and
claude
committed
84345e7
Document what StopOnError means inside a batch

imranakram
and
claude
committed
5de7f56
Name the failing row when a bulk batch faults under StopOnError

imranakram
and
claude
committed
9191506
Show the record id when a block matches on the primary key

imranakram
and
claude
committed
1ce09c1
Report the unexecuted count when an individual fallback aborts

imranakram
and
claude
committed
57be1c5
Explain why the upsert paths are kept

imranakram
and
claude
committed
dd1a337

Commits on Sep 10, 2026

Do not fail deferred records that were never written

imranakram
and
claude
committed
dea6452
Name the record that actually faulted inside a batch

imranakram
and
claude
committed
c67cf65

Commits on Sep 11, 2026

Default to no batching unless BatchSize is set

imranakram
and
claude
committed
29a3c27
Bring the batch size docs in line with the new default

imranakram
and
claude
committed
e63a660
Log the resolved prerequisite version

imranakram
and
claude
committed
8d5be17
Add a test project for the shuffle core

imranakram
and
claude
committed
143b591
Run the tests in CI

imranakram
and
claude
committed
355e449
Add test doubles for the container and organization service

imranakram
and
claude
committed
36c7016
Test how batch responses are matched to requests

imranakram
and
claude
committed
d701272
Test the bulk message paths and their fallbacks

imranakram
and
claude
committed
80231b4
Add FakeXrmEasy fixtures for match and upsert selection

imranakram
and
claude
committed
90d9815
Test the deferred state and owner pass

imranakram
and
claude
committed
6d4771f
Test guid remapping and pending create references

imranakram
and
claude
committed
70cd3c2
Test the batch error reporting fixes

imranakram
and
claude
committed
52905b6
Answer the Debug-only FetchXml conversion in the test rig

imranakram
and
claude
committed
7623c6b
Test both configurations in CI

imranakram
and
claude
committed
a5ec690

Commits on Sep 12, 2026

Drop the framework references the test project never uses

imranakram
and
claude
committed
2970337
Cover the two fixes outside the batching machinery

imranakram
and
claude
committed
ff28e56