As nicely succinct as the previous answer may have been, it's not quite accurate.
I've found that if you create a custom view, and indicate that it should be available for "All Task Folders" (View - Current View - Define Views - New View - Can be used on All Task Folders), the new view will appear at the bottom of the list.
If, however, you select: Can be used on: "This folder, visible to everyone", the new view(s) will appear at the top of the list.
You cannot delete the predefined views. However, you can create copies of them, and then give them creative names to control the order in which they appear. In the Custom View Organizer, you can then click the tick box to "Only show views created for this folder", which will hide the undesired ones.
