AVAssetWriter忽略转换值

Question

我正在使用绑定到AVCaptureSession的现有AVCaptureStillImageOutput来获取静态图像。 然后我需要将它们写入AVAssetWriter，最后以1秒的间隔获得填充帧的视频文件。

除了在纵向模式下输出视频尺寸外，一切正常。 当设备处于横向模式时 - 一切都很好，因为captureStillImageAsynchronouslyFromConnection会生成尺寸为1920x1080（例如）的CMSampleBuffer，但是当设备处于纵向模式时，它仍会生成具有相同尺寸（1920x1080）的旋转CMSampleBuffer。 我可以使用AVAssetWriterInput的.transform属性旋转最终输出视频，它工作正常，但最终视频的尺寸错误（1920x1080），但应该是1080x1920。

我发现问题出在captureStillImageAsynchronouslyFromConnection的CMSampleBuffer中，它始终具有横向尺寸。 然后AVAssetWriter的输入忽略配置的宽度和高度并使用CMSampleBuffer的尺寸。

有人知道如何解决这个问题吗？

注意：我知道可以使用vImage或Core Graphics函数旋转捕获的缓冲区，但出于性能考虑，我想避免使用此方法。 我的问题看起来像配置问题或iOS中的错误...

- (void) setupLongLoopWriter
{
self.currentFragment.filename2 = [VideoCapture getFilenameForNewFragment];
NSString *path = [NSString stringWithFormat:@"%@/%@", [GMConfig getVideoCapturesPath], self.currentFragment.filename2];

CMVideoDimensions dimensions = CMVideoFormatDescriptionGetDimensions(self.currentCamera.activeFormat.formatDescription);

CGSize videoWriterFrameSize = CGSizeMake(dimensions.width, dimensions.height);

float rotationAngle = 0.0;

switch ((UIDeviceOrientation)[self.currentFragment.orientation unsignedIntValue])
{
    case UIDeviceOrientationUnknown:
    case UIDeviceOrientationPortrait:
    case UIDeviceOrientationFaceUp:
    case UIDeviceOrientationFaceDown:
        rotationAngle = DEGREES_TO_RADIANS(90);
        videoWriterFrameSize = CGSizeMake(dimensions.height, dimensions.width);
        break;

    case UIDeviceOrientationPortraitUpsideDown:
        rotationAngle = DEGREES_TO_RADIANS(-90.0);
        videoWriterFrameSize = CGSizeMake(dimensions.height, dimensions.width);
        break;

    case UIDeviceOrientationLandscapeLeft:
        rotationAngle = 0.0;
        break;

    case UIDeviceOrientationLandscapeRight:
        rotationAngle = DEGREES_TO_RADIANS(180.0);
        break;
}

    //  NSLog(@"%.0fx%.0f", videoWriterFrameSize.width, videoWriterFrameSize.height);

NSError *error = nil;

self.currentFragment.longLoopWriter = [[AVAssetWriter alloc] initWithURL:[NSURL fileURLWithPath:path]
                                                       fileType:AVFileTypeQuickTimeMovie
                                                          error:&error];
NSParameterAssert(self.currentFragment.longLoopWriter);

NSDictionary *videoSettings = [NSDictionary dictionaryWithObjectsAndKeys:
                               AVVideoCodecH264, AVVideoCodecKey,
                               AVVideoScalingModeResizeAspect, AVVideoScalingModeKey,
                               [NSNumber numberWithInt:videoWriterFrameSize.width], AVVideoWidthKey,
                               [NSNumber numberWithInt:videoWriterFrameSize.height], AVVideoHeightKey,
                               nil];

AVAssetWriterInput* writerInput = [AVAssetWriterInput assetWriterInputWithMediaType:AVMediaTypeVideo
                                                                     outputSettings:videoSettings];
writerInput.expectsMediaDataInRealTime = YES;

if (rotationAngle != 0.0)
    writerInput.transform = CGAffineTransformMakeRotation (rotationAngle);


NSDictionary *sourcePixelBufferAttributesDictionary = [NSDictionary dictionaryWithObjectsAndKeys:
                                                       [NSNumber numberWithInt:kCVPixelFormatType_32ARGB], kCVPixelBufferPixelFormatTypeKey, nil];

self.currentFragment.longLoopWriterAdaptor = [AVAssetWriterInputPixelBufferAdaptor assetWriterInputPixelBufferAdaptorWithAssetWriterInput:writerInput sourcePixelBufferAttributes:sourcePixelBufferAttributesDictionary];

NSParameterAssert(writerInput);
NSParameterAssert([self.currentFragment.longLoopWriter canAddInput:writerInput]);


[self.currentFragment.longLoopWriter addInput:writerInput];

if( [self.currentFragment.longLoopWriter startWriting] == NO )
    NSLog(@"Failed to start long loop writing!");

[self.currentFragment.longLoopWriter startSessionAtSourceTime:kCMTimeZero];
}

- (void) captureLongLoopFrame
{
if ([GMConfig sharedConfig].longLoopFrameDuration == 0.0) {
    [self.longLoopCaptureTimer invalidate];
    self.longLoopCaptureTimer = nil;

    return;
}

if (self.captureSession.isRunning == NO || self.currentFragment.longLoopWriterAdaptor == nil)
    return;

[self.shutterOutput captureStillImageAsynchronouslyFromConnection:[self.shutterOutput.connections objectAtIndex:0]
                                                completionHandler:^(CMSampleBufferRef imageDataSampleBuffer, NSError *error) {
    if (imageDataSampleBuffer != NULL && error == nil) {
        /*
        CMVideoDimensions dimensions = CMVideoFormatDescriptionGetDimensions(CMSampleBufferGetFormatDescription(imageDataSampleBuffer));
        CGSize videoWriterFrameSize = CGSizeMake(dimensions.width, dimensions.height);

        NSLog(@"Image buffer size: %.0fx%.0f", videoWriterFrameSize.width, videoWriterFrameSize.height);
        */

        double offset = [[NSDate date] timeIntervalSinceDate:self.currentFragment.start];
        CMTime presentationTime = CMTimeMake(offset*1000, 1000);

        CVImageBufferRef imageBuffer = CMSampleBufferGetImageBuffer(imageDataSampleBuffer);




        if (self.currentFragment.longLoopWriterAdaptor.assetWriterInput.readyForMoreMediaData == YES) {
            if( [self.currentFragment.longLoopWriterAdaptor appendPixelBuffer:imageBuffer withPresentationTime:presentationTime] == NO ) {
                NSLog(@"Error adding frame to long loop!");
            }
        }

        NSLog(@"Long loop updated at %0.1f", CMTimeGetSeconds(presentationTime));
    }
}];
}

Answer 1

我只以纵向模式录制，我可以通过使用AVCaptureConnection上的setVideoOrientation直接从摄像机获取旋转像素数据来传递给AVAssetWriter来避免此问题（请参阅https://developer.apple.com/library/ios/qa/ qa1744 / _index.html ）

for (AVCaptureConnection *connection in [videoOutput connections] ) {
            for ( AVCaptureInputPort *port in [connection inputPorts] ) {
                if ( [[port mediaType] isEqual:AVMediaTypeVideo] ) {

                    [connection setVideoOrientation:AVCaptureVideoOrientationPortrait];

                }
            }
}