Father Anthony McSweeney denies a number of charges relating to alleged incidents at Grafton Close Home in London in the 70s and 80s.
The 68 year old was close to John Stingemore, who managed the home between 1979 and 1981, the jury was told.
Mr Stingemore was due to also stand trial for alleged abuse but died in January. He had denied the charges.
Sarah Plaschkes QC told the jury Stingemore took his "favourites" to a house in East Sussex where Fr McSweeney would be.
The court heard how the alleged victims were told to "have a shower and dress smartly" before being taken upstairs to the men.
It's also claimed the priest took pictures of an alleged victim.
"Afterwards he said something along the lines of 'This is just between us, don't you be telling anyone else'," the jury was told.
Indecent images of young boys were found on the priest's computer when he was arrested in 2013, the court heard.
Fr McSweeney denies four counts of indecent assault, three of making indecent images of a child and one of taking indecent images of a child.
The trial at Southwark Crown Court continues.