Khosrowshahi was speaking at an investor forum in Tokyo on his first visit to Asia as Uber CEO.
Japan is seen as a potentially lucrative ride-hailing market, with regulators under pressure to ease stringent rules. Khosrowshahi pushed back against that notion in an interview he gave at Davos, saying the company would be "leaning forward" to expand.
A partnership, as Khosrowshahi hinted at, could help Uber push further into the market. Sony plans to use its AI tech to predict taxi demand and make sure that the right number of cars are available at all times.
Uber still faces an uphill battle in Japan. Toyota has also recently secured a stake in domestic ride-hailing service JapanTaxi.
USA -based Uber Technologies is in talks to offer dispatch systems to taxi providers including Japan's Daiichi Koutsu Sangyo.
Sony's platform will be based on its artificial intelligence (AI) technology. The six taxi companies (Green Cab, International Motor, Kusumi Transportation, Checker Cab Radio Cooperative Association, Hinomaruku Transporation, and Daiwa Motor) have a combined fleet of 10,000 cabs in the Greater Tokyo Area.
Uber's CEO said Japan's taxi utilization rate is 30 percent, while Uber's is more than 50 percent.
These AI-based systems will eventually be offered to taxi operators nationwide, including one-stop-shop solutions and packages. It also plans to launch its Uber Eats service in Egypt later this year. That's a turnaround from previous boss Travis Kalanick, who largely left the country in the hands of a local manager.
If successful, the JV could also become a competitor to players already in the ride-hailing industry, including Toyota and SoftBank, a prominent Uber investor. Which sort of limits the reach of ride-sharing companies like Uber.
Uber's announcement came shortly after Sony's announcement, and the two companies are expected to go head to head in this sector of the Japanese market. "If you're going to do business with SoftBank, you have to get used to the way that they do business with your competition", he said.