Empty space with Screen Capture kit full screen window recording

We're seeing a very similar problem when capturing Chrome's full screen windows, it's reproducible usually when "Always Show Toolbar in Full Screen" is enabled:

There's transparent space in the top/right part of the window with the "sharing" icon in the top left. The main window's content is shifted to the bottom left.

We are seeing this issue with all applications. Issue is that the content rect given by Screen Capture Kit in CMSampleBufer includes the empty space at the top. This makes it very difficult to select only the area where window content is present.

Hey,

We've found a potential workaround which seems to fix the fullscreen Chrome case for us.

Try using setSourceRect on SCStreamConfiguration by passing the CGRect of the window you're trying to share. We obtain these from the SCWindow / frame property taken from the results of SCShareableContent getShareableContentWithCompletionHandler.

Even though the docs of setSourceRect say:

The system doesn’t reference this value when you capture a single window because it captures the full bounds of the window.

It seems like this makes the underlying logic reconsider something and excludes the padding area.

It seems when window is in full screen the CMSampleBuffer returned has different video dimensions in CMVideoFormatDescription and the Content Rect.

CMSampleBuffer formatDescription = <CMVideoFormatDescription 0x6000027066d0 [0x7ff8558ff750]> { mediaType:'vide' mediaSubType:'420v' mediaSpecific: { codecType: '420v' dimensions: 3584 x 2240 } } sampleAttachmentsArray[0] = { sample 0: SCStreamUpdateFrameDisplayResolution = 2 SCStreamUpdateFrameContentRect = { Height = "1120.000020503998"; Width = "1724.261199951172"; X = 0; Y = 0; } }

It seems video dimension gives the correct rect which excludes the empty space. So having ContentRectHeight * DisplayRes - (ContentRectHeight * DisplayRes - VideoDimensionheight) from content rect will give the actual content rect.