Player Group Two LD Session Notes
| Participant | Comment | |
| Learning | 401 | Used TOC and step forward to find test answers |
| 401 | Confessed that artificial setting made him less inclined to explore the wordy link list | |
| 401 | DoesnÕt feel player will help with learning | |
| 300 | User wants text book model with full index/search function and glossary in order to assist with exploration of material and learning | |
| 300 | User does not watch whole video | |
| 502 | Finds that stepping forward through captions is useful way to learn content without listening/watching video | |
| 502 | Utilizes full text to find answers to test | |
| 501 | Attempts to find answers in TOC and full text caption rather than watch whole video | |
| Captions & Annotations | 401 | Useful to help keep participant interested and focused in the video material |
| 401, 300 | Participant finds tracking annotations, captions and video all at once difficult | |
| 301 | Selection of caption type before turning on caption is backwards | |
| 301 | Full caption text does not make sense | |
| 300 | User able to change preferences comfortably but is not able to change background colour due to black on black text and placement of text labels as well as label colour | |
| 300 | Participant utilizes captions and full text to find answers to test | |
| 400 | User comfortable with changing font sizes | |
| 502 | Way captions are displayed is annoying. DoesnÕt fitÑlarger than video | |
| 502 | Takes a bit of time before participant realizes that back button has to be pressed repeatedly | |
| 502 | Participant fails to notice annotations first time through video | |
| 501 | Participant suggests ding to notify annotations | |
| 501 | Annotations are obscuring top of video (canÕt see all of equation) | |
| Hyperlinks | 401 | Likes difference in link appearance as well as additional material |
| 301 | Ònarrative textÓ not understood | |
| 301 | DoesnÕt look like a hyperlink list | |
| 301 | Why not put all of the same info on the same page instead of multiple sub-links? | |
| 301 | When open the hyperlink list is called the master link list | |
| 301 | Links embedded in captions or annotations are not accessible to users who do not enable these features | |
| 300 | User not always clear on what is a hyperlink | |
| 300 | User uses links to find test answers | |
| 300 | Link repetition in master link list is confusing to participant and causes extra work to make sure links point to same information | |
| 300 | Counter information with links is useless to participant since video does not have counter | |
| 400 | Blue of hyperlinks is difficult for participant to see | |
| 500 | User does not like right click | |
| 501 | Ding is scaryÑsofter chime recommended | |
| Video Controls | 401 | Likes ability to skip parts he doesnÕt want to watch |
| 301 | Slider only indication of jumping through videoÑhard to tell that navigation via TOC has had effect | |
| 301 | Forced type selection before enable seems backwards for any of the options | |
| 301 | Inconsistent language between general tap and onscreen settings | |
| 301 | blocks in General Tab preview window are meaningless | |
| 301 | Participant does not realize that step forward is not continuous | |
| 300 | Step buttons too slow for user | |
| 300 | User finds captions helpful despite not expecting to use them | |
| 400 | Back button too slowÑends up using scrub bar | |
| 400 | Participant has difficulty finding marker on scrub bar to take video back to the beginning. | |
| 500 | Could make slider bigger for LVs (use java swing control instead of Quicktime) | |
| 500 | Have video counter or remove references to counter | |
| 502 | Need reset button to move video to beginning | |
| 501 | Slider used to move video to beginning | |
| 501 | What is point of counter references when no counter | |
| User Error/bugs/Issues | 401 | Calculations page noticeably confusing for participant |
| 301 | Captions are showing at the bottom of the screen but the preview window shows them at the top | |
| 401 | Participant unaware that browser window has opened ÒbehindÓ player | |
| 401 | Choppy video noted | |
| 301 | Right click incongruous with TOCÕs explorer window feel | |
| 301 | Colour selection boxes are confusing | |
| 301 | Right click does not make sense | |
| 301 | Should also be annotation quick setting | |
| 301 | Video shouldnÕt start on its own | |
| 301 | TOC icons are confusing | |
| 300 | Video covers captions placed in top right | |
| 300 | User does not like alternative clicking required for links and navigation | |
| 300 | At first user not able to tell if click on TOC has advanced video | |
| 300 | User notes inconsistent language between caption and transcript labels | |
| 300 | TOC icons not intuitive to participant | |
| 400 | User confuses ÒselectÓ with save | |
| 400 | Caption font changes colour regardless of settings | |
| 400 | User places captions on top of annotation but does not realize it until 17 minutes have elapsed | |
| 400 | User disables annotations even though he actually wants to view them. | |
| 400 | Participant wants to change caption setting and does not realize he is on annotation tab | |
| 500 | User does not like right click | |
| 502 | Captions have to be switched to none and then on again in the quick settings for the changes to take effect | |
| 502 | User wants larger screen area for player | |
| 501 | Video is choppy/flickers--distracting | |
| 501 | Too much black space around videoÑlooks unbalanced | |
| 501 | User finds language not intuitive: didactic, verbatim, author settings |
Authoring Tool Evaluation
October 8, 2002.
| Issues | Suggestion | Priority | Responsibilities |
| LOR Location prompt | It would be really nice if we could just hardcode this for the trial especially if the web-based one will not require a pointer to the repository. Or at least have the explorer point to the AT folder so that less navigating is required. | ||
| Meta Data of existing learning objects | In the trial version it will be best if all learning objects have relevant titles | ||
| Insert Caption from repository: Type and Language prompt | It surprised me that I was prompted about the type and language of a pre-made caption track. Is it meant to be informative or do you really think that it is appropriate to change the type at this point? Information about the track is already available at the selection point so having the other window pop up seems redundant and scary for Ms. Smith. | ||
| Insert caption/annotation from repository does not actually work (the rest of them are fine) | Probably this problem is unique to my set-up but IÕm telling you just in case (and I did do the ÒreplaceÓ thing although it was not obvious that it did anything) | ||
| Insert New needs an escape hatch on dialogue boxes | Include a cancel button on insert new dialogue boxes. Hitting x still results in a track being inserted | ||
| Right click menu | It would be a nice touch to have right click access to the edit menu on the track title bar. | ||
| Save presentation | Where the heck does it go? OK, I found this information in the meta data and have a gripe about that too. The save function should indicate where the save is happening and provide opportunity to cancel the operation and to change the folder location. Creation of a new folder at this point is standard and should be available as well. | ||
| Presentation Location | I used the location but added a non-existent file and a new file name then hit close and then clicked save all. No error messages, no warnings and the thing saved where it wanted to with the name it wanted in the first place. A browse and create new folder function here would be excellent or remove altogether and leave location information for the save function. I guess the whole thing might be complicated by the fact it will be web-based and I am treating it like it is not but even still I think following the typical save set-up for a local application will make the whole thing more intuitive. The most important thing, I think, is that the location information be added to the save function in the form of a dialogue even if it just shows the location from the meta-data without opportunity to change it there. There should always be a cancel though. | ||
| Edit meta-data when track not selected does not prompt for track selection | Add a Please select a track prompt | ||
| Time setting could be confusing | Consider adding a heading above the setting box that shows hh:mm:ss.0 or something like that | ||
| Dialogue boxes for insert from LOR do not show up on task bar and are not always on top of window yet they lock the AT if they are not completed | Have dialogue always on top or on task bar so that if it is accidentally buried under another application window there is a hint about what the problem is when the AT wonÕt work. | ||
| Some language is techie-talk | Ms. Smith would probably rather know the new style will be the same as the old style except where she makes changes. Parent and inherit are not used in this way by non-developers and may be confusing. | ||
All things told, I found using the AT OK. The dialogue boxes for meta-data seemed complicated and could have the opposite of their intended effect: users may feel overwhelmed and not enter any information rather than provide the detailed information needed to make a system like this work. I would like a less technical feeling dialogue in this area or option to have a guided walk through the meta-data inputs. Perhaps this is where training and documentation come in as a factor. I liked how easily I could manipulate blocks within the track and found that it was a simple task to add new tracks and tracks from the repository (this comment excludes the meta-data dialogues).