Need Help with Unity Vision Pro Application

I was trying to built a ChatGPT like assistant/client using Unity on MacOSX. The web service is running locally and I am able to test it on both the Vision Pro Simulator as well as doing curl request and they work, but when I deploy it in the actual device, I get network error.

I am trying to find what would make vision pro actually make a successful http call to the local service using the C# script i am using.

I have tried the following hostname to see if it works (all machines inc AVP are on sample network)

  1. The local IP address - 192.x.x.x
  2. localhost
  3. 127.0.0.1

Here is the error i see on the AVP.

Task <14990261-F296-4D80-B2C4-FF0501E1B2F2>.<1> finished with error [-1004] Error Domain=NSURLErrorDomain Code=-1004 "Could not connect to the server." UserInfo={_kCFStreamErrorCodeKey=61, NSUnderlyingError=0x28279fa20 {Error Domain=kCFErrorDomainCFNetwork Code=-1004 "(null)" UserInfo={_NSURLErrorNWPathKey=satisfied (Path is satisfied), viable, interface: lo0, _kCFStreamErrorCodeKey=61, _kCFStreamErrorDomainKey=1}}, _NSURLErrorFailingURLSessionTaskErrorKey=LocalDataTask <14990261-F296-4D80-B2C4-FF0501E1B2F2>.<1>, _NSURLErrorRelatedURLSessionTaskErrorKey=(
    "LocalDataTask <14990261-F296-4D80-B2C4-FF0501E1B2F2>.<1>"
), NSLocalizedDescription=Could not connect to the server., NSErrorFailingURLStringKey=http://127.0.0.1:8000/v1/chat/completions, NSErrorFailingURLKey=http://127.0.0.1:8000/v1/chat/completions, _kCFStreamErrorDomainKey=1}
-------------------------------------------
Error While Sending: Cannot connect to destination host
<postRequestWithJson>d__4:MoveNext()
UnityEngine.SetupCoroutine:InvokeMoveNext(IEnumerator, IntPtr)

-> applicationWillResignActive()
-> applicationDidEnterBackground()

Can anyone point me to what I am doing incorrectly. I am new to xcode and apple products dev in general