This was so easy (except who gives glue/water to 16 3rd-8th graders and tells them "not to make a mess"...)
We used paper lunch bags that we tore into strips.
Then, dipped them into glue/water mixture (like paper mache) in a criss-cross pattern. We let them dry on tin-foil so it was easy to pull them off.
Afterward, we decorated our papyrus with some Egyptian stencils.
Turned out nice!