There seems to be a lack of interactive elements in the core progression system. The Kana tester is nice, but I already know my Kana, and I'm sure the Kanji tester will be worth a shot when it's released. However, I want to be able to test my knowledge of grammar points taught in lessons, too.
You probably wouldn't have to get above 50% to continue onto the next milestone set of units; it'd just be a test of your comprehension, at least to start with.
And at the very end of a Phase, you could have a longer test and set a time limit. If you wanted to get real fancy, you could link the questions to a particular unit, and if a student gets that question wrong, in the end when giving the results, you can recommend they revise (these units) for a better understanding of the grammar, and then retake the test.
- What particle should go here? (multiple choice)
- Which of these is a real example of casual Japanese? (multiple choice)
- Which of these sentences is grammatically incorrect? And a set of 4 unrelated sentences (e.g. 寒かったでしたか？ would be incorrect)
- Comprehension Test: Which of these sentences explains why Yuzuru can't come to school today? A: ゆずるは日本人です。 B: ゆずる風をひいたの。 C: ハーバード大学 は頭がいい生徒で有名だ。
- Form a sentence in casual Japanese that means roughly this [English sentence] with these elements (duolingo style)
- A short-medium length text in Japanese with 5-10 multiple choice questions afterward testing comprehension. This test could also be timed. (this is what I would most like to see)
So, Phase 1 would end up with 10 Quizzes, or roughly one every 16 units. On the 4 year path, you'd be hitting that once every two weeks, and on the 2 year path, once every week. That seems like a good amount of comprehension testing without overwhelming students.
If I didn't know any better, I would think that something like this was already planned with the way units are divided up like this.