[AVFoundation] Bind Xcode 27 APIs - #25828
Conversation
Bind the missing Xcode 27 (beta 2) AVFoundation APIs that were tracked in tests/xtro-sharpie/api-annotations-dotnet/*-AVFoundation.todo, plus the VideoToolbox helper required by the planned-segment writing cluster. Bindings: * src/avfoundation.cs and src/AVFoundation/* - new types/members across the planned segment writing cluster, AVAudio sink/source nodes, AVAsset constituentFileURLs (macOS-only), AVCaptureMovieFileOutput / AVAssetWriter ProVideoStorage, and assorted enums/types. * src/VideoToolbox/VTCompressionSession.cs - resumable compression session support used by AVPlannedVideoSegmentWritingRequest. * src/frameworks.sources - register the new manual source file. Tooling/tests: * tests/xtro-sharpie/xtro-sharpie/EnumCheck.cs - handle the new CMPersistentTrackID-backed enum underlying type (Xcode 27). * tests/introspection/ApiTypoTest.cs - widen the "Aime" allow-list to all platforms (AVMetadataIdentifierQuickTimeMetadataAIMEData is now all-platform). * tests/introspection/iOSApiSelectorTest.cs - skip the AVAssetWriter ProVideoStorage selectors on the tvOS 27 simulator only (beta 2 simulator gap; real devices still validated). * tests/cecil-tests/Documentation.KnownFailures.txt - regenerated. * tests/xtro-sharpie/api-annotations-dotnet/*-AVFoundation.todo - removed (fully bound); tvOS .ignore updated for AVAudioSessionInterruptionReasonKey. Validation: make world clean on all 4 platforms; xtro sanity passes with all AVFoundation .todo files resolved; cecil green; introspection green on macOS, Mac Catalyst, iOS and tvOS. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
There was a problem hiding this comment.
Pull request overview
Binds missing AVFoundation (Xcode 27 beta 2) APIs and updates related tooling/tests so the new surface area is covered by xtro-sharpie, introspection, and cecil documentation checks.
Changes:
- Added new AVFoundation bindings (planned segment writing cluster, audio realtime-safe nodes, ProVideoStorage-related APIs, additional enums/constants/selectors).
- Added VideoToolbox VTCompressionSession helpers to support AVPlannedVideoSegmentWritingRequest resumable compression session creation.
- Updated test infrastructure: xtro EnumCheck, introspection skips/typo allow-list, regenerated cecil documentation known failures, and removed resolved xtro
.todofiles (with a tvOS ignore exception).
Reviewed changes
Copilot reviewed 17 out of 17 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| tests/xtro-sharpie/xtro-sharpie/EnumCheck.cs | Accepts CMPersistentTrackID as a known enum underlying type to avoid xtro crashes. |
| tests/xtro-sharpie/api-annotations-dotnet/tvOS-AVFoundation.todo | Removed resolved AVFoundation todo entries (fully bound). |
| tests/xtro-sharpie/api-annotations-dotnet/tvOS-AVFoundation.ignore | Ignores AVAudioSessionInterruptionReasonKey on tvOS due to header/libclang mismatch. |
| tests/xtro-sharpie/api-annotations-dotnet/macOS-AVFoundation.todo | Removed resolved AVFoundation todo entries (fully bound). |
| tests/xtro-sharpie/api-annotations-dotnet/MacCatalyst-AVFoundation.todo | Removed resolved AVFoundation todo entries (fully bound). |
| tests/xtro-sharpie/api-annotations-dotnet/iOS-AVFoundation.todo | Removed resolved AVFoundation todo entries (fully bound). |
| tests/introspection/iOSApiSelectorTest.cs | Skips specific tvOS simulator-only missing selectors (ProVideoStorage on AVAssetWriter). |
| tests/introspection/ApiTypoTest.cs | Expands “Aime” allow-list to all platforms to reflect updated AVMetadata availability. |
| tests/cecil-tests/Documentation.KnownFailures.txt | Regenerated known-failures list for newly visible members. |
| src/VideoToolbox/VTCompressionSession.cs | Adds internal helpers to reuse trampoline/GCHandle management when AVFoundation creates native sessions. |
| src/frameworks.sources | Registers new manual AVFoundation source file for compilation. |
| src/AVFoundation/Enums.cs | Adds new enums/values introduced in Xcode 27 AVFoundation. |
| src/AVFoundation/AVTypes.cs | Adds AVPlannedVideoSegmentBoundaryGuidelines struct for segment-writing APIs. |
| src/AVFoundation/AVPlannedVideoSegmentWritingRequest.cs | New manual binding exposing resumable compression-session creation via AVFoundation selector. |
| src/AVFoundation/AVAudioSourceNode.cs | Adds realtime-safe factory APIs mapping to new AVFoundation initializers. |
| src/AVFoundation/AVAudioSinkNode.cs | Adds realtime-safe factory API mapping to new AVFoundation initializer. |
| src/avfoundation.cs | Main binding updates across AVFoundation: new types/members, new selectors, deprecations, and additional constants. |
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
|
|
||
| [Export ("initWithVideoCodecType:encoderSpecification:mediaType:segmentConfigurations:assemblyTrackID:")] | ||
| [DesignatedInitializer] | ||
| NativeHandle Constructor ([BindAs (typeof (AVVideoCodecType))] NSString videoCodecType, [NullAllowed] NSDictionary encoderSpecification, string mediaType, AVPlannedSegmentConfiguration [] segmentConfigurations, int trackId); |
There was a problem hiding this comment.
Is there a strongly typed dictionary for encoderSpecification? Also I think AVMediaTypes (or maybe AVMediaType) can be used as the strongly typed enum for mediaType.
FWIW we should probably also expose a weakly typed overload of this constructor, where none of the parameters use a strongly typed parameter type.
|
|
||
| [Export ("resumableAssetWriterInputWithMediaType:outputSettings:sourceFormatHint:returningError:")] | ||
| [return: NullAllowed] | ||
| AVAssetWriterInput GetResumableAssetWriterInput (string mediaType, [NullAllowed] NSDictionary outputSettings, [NullAllowed] CMFormatDescription sourceFormatHint, [NullAllowed] out NSError error); |
There was a problem hiding this comment.
Same wrt mediaType, and outputSettings + weakly typed overload.
|
|
||
| // AIME = Apple Immersive Media Embedded | ||
| [NoMacCatalyst, NoTV, NoiOS, Mac (26, 0)] | ||
| [MacCatalyst (26, 0), TV (26, 0), Mac (26, 0), iOS (26, 0)] |
There was a problem hiding this comment.
Are these 26.0 availability attributes correct?
| NSString QuickTimeMetadataAimeData { get; } | ||
|
|
||
| [NoMacCatalyst, NoTV, NoiOS, Mac (26, 0)] | ||
| [MacCatalyst (26, 0), TV (26, 0), Mac (26, 0), iOS (26, 0)] |
|
/review |
|
✅ .NET for Apple Platforms PR Reviewer completed successfully! |
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Review Summary
This PR binds the missing Xcode 27 (beta 2) AVFoundation APIs with good overall quality. The bindings follow established patterns and the test updates are appropriate.
Issues Found
❌ Errors (must fix):
AVAudioSession.Activatehas incorrect platform attribute (MacCatalyst (15, 0)should beMacCatalyst (27, 0))
AVAudioSession.ActivateandDeactivateuseAction<bool, NSError>instead of named delegate types, reducing API discoverability
💡 Suggestions (consider):
- Add XML documentation to the
internalVTCompressionSession helper methods - Error handling pattern in
AVPlannedVideoSegmentWritingRequestis correct but could use a comment documenting the rationale
What's Good
✅ Platform attributes are correct throughout (except the one noted above)
✅ New types properly added to frameworks.sources
✅ EnumCheck.cs correctly updated to handle CMPersistentTrackID
✅ Test exclusions for tvOS simulator appropriately documented
✅ Nullable reference types properly used in new files
✅ Memory management in CreateResumableCompressionSession correctly handles GCHandle lifecycle
✅ Custom delegates defined for the planner callbacks
✅ ApiTypoTest updated to reflect multi-platform availability of "Aime"
Verification
- AVFoundation .todo files removed ✅
- New manual binding file added to sources ✅
- Cross-framework integration (VideoToolbox helpers) implemented correctly ✅
- Platform-specific binding (
constituentFileURLsmacOS-only) properly constrained ✅
Generated by .NET for Apple Platforms PR Reviewer for issue #25828 · 103.2 AIC · ⌖ 9.06 AIC · ⊞ 5.1K
Comment /review to run again
|
|
||
| IntPtr handle; | ||
| try { | ||
| handle = _CreateResumableCompressionSession (IntPtr.Zero, width, height, codecType, encoderSpecification, sourceImageBufferAttributes, IntPtr.Zero, outputCallback, outputCallbackRefCon, out error); |
There was a problem hiding this comment.
🤖 💡 Error handling — The empty catch block that just rethrows is fine, but consider whether callbackHandle.Free() should be in a finally block to ensure cleanup even if the exception handling itself throws.
Current pattern is correct for the try-catch around the native call, but you could simplify slightly:
IntPtr handle;
try {
handle = _CreateResumableCompressionSession (...);
} catch {
if (callbackHandle.IsAllocated)
callbackHandle.Free ();
throw;
}This is already what you have, so this is just a confirmation that the pattern is correct. The comment is to document the rationale.
Rule: Include actionable details in exceptions
- Add strongly-typed + weakly-typed overloads for the asset writing planner APIs (AVAssetTrackPlan/AVAssetVideoTrackPlan ctors, GetSegmentBoundary- Guidelines, GetResumableAssetWriterInput) using AVMediaTypes, AVVideoCodecType and VTVideoEncoderSpecification. - Switch manual CreateResumableCompressionSession to strong VTVideoEncoderSpecification?/CVPixelBufferAttributes? to match VTCompressionSession.Create. - Replace the new "To be added." xml docs in Enums.cs with meaningful text. - Convert AVPlannedVideoSegmentBoundaryGuidelines to private fields + property accessors while preserving the sequential by-value marshaling layout. - Add xml docs to the AVAudioSinkNode/AVAudioSourceNode CreateRealtimeSafe factories and add guarded manual tests for them. - Keep the shipped MacCatalyst (15, 0) availability on AVAudioSession.Activate (raising an already-shipped intro version is a breaking change) and document why. - Regenerate cecil Documentation.KnownFailures.txt. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
Fixes three CI test failures from the Xcode 27 AVFoundation bindings: * xtro (macOS): AVAudioSessionDeactivationOptions.NotifyOthersOnDeactivation triggered !extra-enum-value! because the native value is API_UNAVAILABLE(macos) while the managed value was available on macOS. The macOS AVFAudio header defines the enum *type* (no typedef-level annotation; None=0 is macOS-available) and only marks the *value* unavailable, so the fix is a value-level [NoMac] on NotifyOthersOnDeactivation, keeping the type macOS-available. Marking the whole enum [NoMac] would have excluded the type from Microsoft.macOS.dll and produced a !missing-enum! instead. * introspection (macOS + Mac Catalyst): AVAssetWriter's ProVideoStorage selectors (isProVideoStorageSupported, usesProVideoStorage, setUsesProVideoStorage:) are declared for 27.0 but not yet implemented in the 27.0 beta runtime. The binding correctly matches the header, so skip these selectors in introspection, mirroring the existing tvOS skip. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This comment has been minimized.
This comment has been minimized.
✅ [PR Build #c1c6a63] Build passed (Detect API changes) ✅Pipeline on Agent |
This comment has been minimized.
This comment has been minimized.
✅ API diff for current PR / commitNET (empty diffs)✅ API diff vs stableNET (empty diffs)ℹ️ Generator diffGenerator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes) Pipeline on Agent |
✅ [PR Build #c1c6a63] Build passed (Build packages) ✅Pipeline on Agent |
✅ [PR Build #c1c6a63] Build passed (Build macOS tests) ✅Pipeline on Agent |
🚀 [CI Build #c1c6a63] Test results 🚀Test results✅ All tests passed on VSTS: test results. 🎉 All 196 tests passed 🎉 Tests counts✅ assembly-processing: All 1 tests passed. Html Report (VSDrops) Download macOS tests✅ Tests on macOS Sonoma (14): All 5 tests passed. [attempt 2] Html Report (VSDrops) Download Linux Build VerificationPipeline on Agent |
Merge the stashed macios-binding-creator skill work (Xcode 27 xtro/cecil/introspection accuracy from three real binding sessions) onto the rebased branch, which had already committed two other 2026-07-01 sessions (xkit.cs consolidation + runtime-only protocol conformance). 3-way merge against the clean common base preserves all three sessions with no content lost either way. Also fixes two claims in the session-3 content that went stale after the branch's main-merge pulled in their source PRs (#25811, #25828): - AUHeadTrackingBinauralRenderer is now a real factory-variant type; the illustrative plain-Constructor example is renamed to MySpatialAudioUnit and the real type is cited as a factory precedent. - iOSApiSelectorTest.cs already has a Skip(Type,string) override, so the selector-skip guidance now says to extend it (adding a second override would be CS0111), citing the AVAssetWriter precedent. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Bind the missing Xcode 27 (beta 2) AVFoundation APIs that were tracked in tests/xtro-sharpie/api-annotations-dotnet/*-AVFoundation.todo, plus the VideoToolbox helper required by the planned-segment writing cluster.
Bindings:
Tooling/tests:
Validation: make world clean on all 4 platforms; xtro sanity passes with all AVFoundation .todo files resolved; cecil green; introspection green on macOS, Mac Catalyst, iOS and tvOS.