Run XCTest bundle with simctl
Asked Answered
I

0

8

I have a XCTest bundle which I can run through xcode on a simulator by using simctl. I am using the iPhone 6 iOS 9.1 simulator with the following environment variables:

export SIMCTL_CHILD_TestBundleLocation="/Users/User/ios_app/DerivedData/primus/Build/Products/Debug-iphonesimulator/Tests.xctest"
export SIMCTL_CHILD_XCInjectBundle="/Users/User/ios_app/DerivedData/primus/Build/Products/Debug-iphonesimulator/Tests.xctest"
export SIMCTL_CHILD_XCInjectBundleInto="/Users/User/ios_app/DerivedData/primus/Build/Products/Debug-iphonesimulator/ios_app.app/ios_app"
export SIMCTL_CHILD_XCTestConfigurationFilePath="/Users/User/ios_app/DerivedData/primus/Build/Products/Debug-iphonesimulator/Tests.xctest/Tests-7025D700-AA6C-4343-9C7A-92F9CC3A1C42.xctestconfiguration"
export SIMCTL_CHILD_DYLD_LIBRARY_PATH="/Users/User/ios_app/DerivedData/primus/Build/Products/Debug-iphonesimulator:/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/Library/Frameworks"
export SIMCTL_CHILD_DYLD_FRAMEWORK_PATH="/Users/User/ios_app/DerivedData/primus/Build/Products/Debug-iphonesimulator:/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/Library/Frameworks"

The app is already installed on the simulator by this point and the simulator is running and I run:

xcrun simctl launch booted uk.co.company.ios.app -NSTreatUnknownArgumentsAsOpen NO -ApplePersistenceIgnoreState YES -XCTest All 

The app launches and from the simulator log I can see that the XCTest bundle loads but the tests don't run. I have logged out where it seems to stop and there is a private method _checkForTestManager, more specifically _checkManagerForDaemonStateAndConnectIfAvailable. From what I can tell XCTest is trying to connect to testmanagerd but failing. So I tried kickstarting testmanagerd on the simulator using:

xcrun simctl spawn booted launchctl kickstart system/com.apple.testmanagerd 

But this doesn't seem to have an effect on the tests running, but I do see some additional output in the simulator log:

testmanagerd[41610]: Received new test session connection (-[XCTestManager listener:shouldAcceptNewConnection:])
testmanagerd[41610]: Initial orientation 0
testmanagerd[41610]: Test session <__NSConcreteUUID 0x7fd2bb804a00> 7025D700-AA6C-4343-9C7A-92F9CC3A1C42 requested socket (-[XCTestSession _XCT_requestSocketForSessionIdentifier:reply:])
testmanagerd[41610]: Test session <__NSConcreteUUID 0x7fd2bb804a00> 7025D700-AA6C-4343-9C7A-92F9CC3A1C42 requested socket (__57-[XCTestManager requestSocketForSessionIdentifier:reply:]_block_invoke)
testmanagerd[41610]: -[XCTestManager _handleRequestForSessionWithIdentifier:]

But nothing after that. Compared with when running through Xcode:

testmanagerd[41309]: Test session <__NSConcreteUUID 0x7fd162b016a0> 64B7815C-A0A2-4213-9A5E-E0BB0139F35A requested socket (-[XCTestSession _XCT_requestSocketForSessionIdentifier:reply:])
testmanagerd[41309]: Test session <__NSConcreteUUID 0x7fd162b016a0> 64B7815C-A0A2-4213-9A5E-E0BB0139F35A requested socket (__57-[XCTestManager requestSocketForSessionIdentifier:reply:]_block_invoke)
testmanagerd[41309]: -[XCTestManager _handleRequestForSessionWithIdentifier:]
testmanagerd[41309]: Closing IDE connection before sending socket 8 to test host.
testmanagerd[41309]: -[XCIDESession closeIDEConnection:] sending barrier
testmanagerd[41309]: barrier flushed, closing DTXConnection to IDE, socket will not be closed
testmanagerd[41309]: Socket disconnected
testmanagerd[41309]: __33-[XCTestManager closeIDESession:]_block_invoke <XCIDESession: 0x7fd160514d80>
testmanagerd[41309]: Considering exiting, 1 test sessions, 0 sessions with identifiers, 0 unidentified sessions...
assertiond[39075]: assertion failed: 14F1021 13B137: assertiond + 12188 [93FFE0B6-5C27-387F-B32A-6EE378BBB22A]: 0x1
testmanagerd[41309]: Sending socket 8 to test host
testmanagerd[41309]: __33-[XCTestManager closeIDESession:]_block_invoke <XCIDESession: 0x7fd160514d80>
testmanagerd[41309]: Considering exiting, 1 test sessions, 0 sessions with identifiers, 0 unidentified sessions...
testmanagerd[41309]: IDE connected over socket 7 (__47-[XCTestManagerIDEServer initWithListenSocket:]_block_invoke)
testmanagerd[41309]: Created session with socket 7
testmanagerd[41309]: Handling a proxy request from the IDE
testmanagerd[41309]: -[XCIDESession _IDE_initiateControlSessionForTestProcessID:] 41398
testmanagerd[41309]: Set control session <XCIDESession: 0x7fd160716f60>

Is it possible to run tests through simctl this way?

Internuncial answered 10/11, 2015 at 15:43 Comment(4)
Have you made any progress? I'd be interested in exactly this topic too, but havn't made it any further than you so far.Michaud
I haven't. I actually started doing this as a way of possibly running tests using FBSimulatorControl and got stuck at this point. I've submitted a radar but Apple only asked why I wasn't happy with using xcodebuild/xcodeInternuncial
I'm optimistic this can be done... still trying to figure it out myself. Perhaps testmanagerd needs to be launched with certain arguments.Cabalistic
Was this ever solved? Still interested!Qumran

© 2022 - 2024 — McMap. All rights reserved.