There are two third party paid apps which let you customize the dashboard pretty much anyway you want it. Both are very popular in the community. Many people use them for control panels on tablets, but they can also be used on mobile phones, and a popular use case for that is limiting the devices that one child in the family has access to. 
You can see a recent discussion of them here. (The topic title is a clickable link)
Both have a free trial so you can check them out.
(BTW, You will see comments in that thread from @tgauchat Who was one of the developers for actiontiles. He sadly passed away late last year. If you have any questions about any of his posts, just reply to them and tag @625alex and he will be able to answer your questions.)