The clergyman who also investigated the Hillsborough disaster will look to find out what happened to cause the deaths at Gosport War Memorial Hospital between the 1980s and 2000s.
There has been accusations of an over use of painkillers.
Bishop James will be joined by geriatric medicine specialist Dr Colin Currie, investigative journalist David Hencke and former Scotland Yard Commander Duncan Jarrett.
Speaking about the investigations Bishop James said: "Many families have on-going concerns about the way their relatives were treated and how their complaints have been handled.
"I want to help provide clarity and understanding for the families.
"By working with them to set and deliver the terms of reference with a panel of experts from different fields, I believe I can achieve this. Independence and integrity will be the hallmarks of the Panel's work."