The document summarizes the results of a card sorting activity conducted by UT Lab Globo.com on May 28-29, 2007 to evaluate the grouping and labels of content on Globo.com's homepage. 17 participants sorted content cards into groups for the main menu and pulldown sections. For the menu, results showed high agreement for "Sports" but lower agreement for "Tools." For pulldowns, "Blogs and Columns" and "Globo TV" had high agreement while some items were placed in multiple categories. The findings will help Globo.com optimize the organization and labels of homepage content.
2. HOME: main menu and pull-downs
INFORMATION ABOUT THE CARD SORTING
3. HOME: menus and pulldowns | CARD SORTING
Objectives To research on content groups and labels
suggested by users
To evaluate the understanding of existing
content groups and labels suggested by the
Globo.com team for the main page
Date 28th and 29th May 2007
Place Globo.com
Methods Open Card Sorting, Closed Card Soting and
Search for Information
4. HOME: menus and pulldowns | CARD SORTING
Participants
17 people, divided into 6 groups
Portal users (Terra, Uol, Ig or Globo.com)
Age range 14 to 45 years old
50% Globo.com users
Groups
Group A: 14 to 17 years old, 3 men
Group B: 18 to 24 years old, 2 men and 1 woman
Group C: 25 to 34 years old, 1 man and 1 woman
Group D: 18 to 24 years old, 2 men and 1 woman
Group E: 25 to 34 years old, 1 men and 2 women
Group F: 35 to 45 years old, 3 women (not considered for the open sorting)
5. HOME: menus and pulldowns | CARD SORTING
Evaluated navigation
The Web portals new home page was evaluated : menu and pulldowns.
6. HOME: menus and pulldowns | CARD SORTING
Executed activities
To help evaluating grouping and labels on Web portal Globo.coms new
home page, the following activities were executed:
Content grouping
Activities were executed in order to research on the grouping suggested
by the users and evaluate the understanding of the grouping proposed
by the Globo.com team.
Information search
Suggested tasks to verify whether the participants can find information
on the structure they helped organise.
Labels evaluation
Analysis of the understanding of labels proposed by the Globo.com
team and research on the labels suggested by the participants.
8. HOME: menus and pulldowns | CARD SORTING
CONTENT GROUPING
OBJECTIVES
To research on content groups suggested by the participants.
To evaluate the understanding of the content groups proposed by the
Globo.com team.
Menu card sorting do menu open
With totally free grouping.
Menu card sorting closed
With pre-determined group titles.
Pulldowns card sorting closed
With pre-determined group titles.
Pulldowns, sub-levels card sorting closed (participant groups C and E)
With pre-determined group titles.
12. HOME: menus and pulldowns | CARD SORTING
News group
Open Sorting
A News related categorisation was adopted by 100% of the
participants.
Agreement on items: moderate, 40%
News related labels were used: Newspapers, TV News
Shows, G1, Journalism, News.
13. HOME: menus and pulldowns | CARD SORTING
News group
Closed Sorting
Agreement on items: moderate, 55%
Items corresponding to G1 were placed within the News
group in 50% of the cases.
Recommendation
To keep the navigation by News.
14. HOME: menus and pulldowns | CARD SORTING
Entertainment group
Open Sorting
An Entertainment related categorisation was adopted by
100% of the participants.
Agreement on items: low, 33%
We should consider that the cards got very dispersed into
categories that could be related to Entertainment (only 1
group used this label).
15. HOME: menus and pulldowns | CARD SORTING
Entertainment group
Closed Sorting
Agreement on items: moderate, 63%
Recommendation
To keep the navigation by Entertainment.
To reassess the positioning of some items or consider the
possibility of duplicating dubious elements.
16. HOME: menus and pulldowns | CARD SORTING
Sports group
Open Sorting
The Sports categorisation was adopted by 100% of the
participants.
Agreement on items: high, 90%
All of the participants used exactly the Sports label for the
correspondent group.
Besides Sports, some created other related groups or sub-
groups, like: Sport events, Football e Other disciplines.
17. HOME: menus and pulldowns | CARD SORTING
Sports group
Closed Sorting
Agreement on items: high, 90%
Same agreement rate of the open sorting.
This is the most consistent category in terms of the agreement
on items and labels utilised by the participants.
Recommendation
To keep the Sports group.
18. HOME: menus and pulldowns | CARD SORTING
Tools group
Open Sorting
The Tools was adopted by 40% of the participants.
Agreement on items: low, 31%
Its interesting to note that the term Tools was utilised
spontaneously during the open sorting, under 2 formats: Tools
and O Globo Tools.
19. HOME: menus and pulldowns | CARD SORTING
Tools group
Closed Sorting
Agreement on items: moderate, 49%
All of the cards that make up the original grouping were placed
into the groups created by the participants, demonstrating a
high level of agreement (more than 60%).
Recommendation
To keep the navigation by Tools.
21. HOME: menus and pulldowns | CARD SORTING
PULLDOWNS
The pulldowns are placed below
the menu, at the lower part of
the Web portals home page.
They are divided into 4 groups
with labeled subdivisions.
When in use, the visibility of the
pulldowns would not be
imediate, which could jeopardise
its utilisation.
23. HOME: menus and pulldowns | CARD SORTING
Blogs and Columns group
Agreement on items
High, of 96%.
Items with agreement below 100%:
L辿dio Carmona Column (20% in Globo TV) and
Cac叩 Bueno Column (17% in Globo TV)
Items that did not belong to the category:
Blog Malha巽達o (100% in Blogs), Di叩rio de SP (17% in Blogs)
and Extra Online (20% in Blogs).
24. HOME: menus and pulldowns | CARD SORTING
Blogs and Columns group
Agreement on the existing subdivisions:
News, moderate, 61%
Entertainment, high, 80%
Sports, high, 89%
Recommendation
To keep the navigation by Blogs and Columns.
In some cases it might be interesting to consider the
duplication of an item in different categories (ex. Blog of
Openings is in News but was placed in Entertainment 100% of
the times).
26. HOME: menus and pulldowns | CARD SORTING
Globo TV group
Agreement on items: high, of 73%.
Items with agreement below 100%: DFTV (60% in +TV), SPTV
(50% in +TV), Blog Malha巽達o (100% in Blogs).
Items excluded from the sorting by 1 group (17%):
Eterna Magia, Para鱈so tropical, A Diarista, A Grande Fam鱈lia, Zorra
total, Auto esporte, Linha Direta, Mais voc棚.
Items that did not belong to the category:
Globo Rural (100% in Globo TV); Caramuru (67%); Amazonica
Network and Olga (33%); Tudo paran叩 (20%); Rede Bahia, Tapaj坦s
TV, Telecine, O Globo Agency, O Globo Classified Ads, O Globo
Newspaper and Radio Globo (17%).
27. HOME: menus and pulldowns | CARD SORTING
Globo TV group
Agreement on existing subdivisions:
Humour, moderate, 61%
Sopa Operas and Miniseries, moderate, 63%
TV News Programmes, high, 74%
Sports, high, 65%
Other programmes, high, 79%
Recommendation
To keep the navigation by Globo TV.
It was well understood by the participants.
28. HOME: menus and pulldowns | CARD SORTING
+ TV group
Agreement on items
High, of 76%.
Items with agreement below 100%:
Amazonic Network (33% in Globo TV), Bahia Network
(17% in Globo TV), Tudo Paran叩 (20% in Globo TV,
20% excluded), Tapaj坦s TV (17% in Globo TV), GloboSat
(17% in Other media), GNT (17% in Other media),
NET (33% in Other media), Telecine (17% in Globo TV,
17% in Othe media).
Items that did not belong to the category:
CBN (33% in +TV), Criativa (17%), SPTV (50%), DFTV (60%).
29. HOME: menus and pulldowns | CARD SORTING
+ TV group
Agreement on existing subdivisions:
Cable TV, high, 91%
Affilliated TVs, moderate, 50%
In general the items that did not fit in the other groups were
placed in this group.
During usage, the names of the subdivisions already appear,
making it easier to understand the group.
Recommendation
To keep the navigation by +TV.
31. HOME: menus and pulldowns | CARD SORTING
Other media group
Agreement on items
High, of 77%.
Items with agreement below 100%:
O Globo Agency (17% in Globo TV, 17% excluded), O Globo
Classified Ads (17% in Globo TV), Criativa (17% in +TV), Di叩rio
de SP (17% in Blogs and Columns), Extra On Line (20% in Blogs
and Columns), O Globo Newspaper (17% in Globo TV), CBN
(33% in +TV), Radio Globo (17% in Globo TV), Olga (33% in
Globo TV); Caramuru (67% in Globo TV).
Items that did not belong to the category:
NET (33% in Other media); Globosat, GNT, Telecine (17%).
32. HOME: menus and pulldowns | CARD SORTING
Other media group
Agreement on existing subdivisions:
Cinema, moderate, 67% (Caramuru and Olga w ere mixed up w ith the miniseries and placed in Globo TV)
Radios, high, 94%
Newspapers and Magazines, high, 97%
Mobile, high, 100%
Group formed through elimination, as the previous one.
During usage, the names of the subdivisions already appear,
making it easier to understand the group.
Recommendation
To keep the navigation by Other media.
34. HOME: menus and pulldowns | CARD SORTING
Cable TV group
During the open sorting, the Cable TV related categorisation
was spontaneously adopted by 60% of the participants.
They used other labels:
Subscription TV channels, Globosat Channels.
Recommendation
Keep the Cable TV group.
35. HOME: menus and pulldowns | CARD SORTING
Children group
During the open sorting, 60% of the participants created a
Children group.
Considering only the participants who created that category,
the agreement on items is of 95%.
Labels used:
Children, Childrens channels, Childrens programmes
Recommendation
To consider the possibility of creating a Children group
gathering the relevant content.
36. HOME: menus and pulldowns | CARD SORTING
Search
The search must be on the main page because from it
you search everything on the website
Recommendation
The Search tool is very important:
- it must work properly
- it must be put in a place of easy access
Many users prefer to do all of the navigation on the website
through the Search.
37. HOME: menus and pulldowns | CARD SORTING
Where would you look for information about
the programme A Grande Fam鱈lia?
Open card sorting:
It was placed in 5 categories: TV Programmes, Programmes,
Programmes and miniseries, Humour, Weekly programmes.
Closed card sorting:
A Grande Fam鱈lia was placed in the Entertainment group by
all of the participants.
Recommendation
To keep the item A Grande Fam鱈lia in Entertainment and in
Globo TV > Humour.
39. HOME: menus and pulldowns | CARD SORTING
LABELS EVALUATION
OBJETIVO
To research on labels suggested by the participants.
To evaluate the understanding of the labels proposed by the Globo.com team.
Guided statement naming
The participant chooses one of the labels proposed by each
statement. If he/she considers none of the alternatives as adequate,
can suggest one he/she deems more apropriate.
Moderator analysis
Evaluation of the labeling understanding through the observation of
participants comments and behaviour.
41. Choose only 1 alternativa.
If you feel none of the names is adequate, you
can suggest another one that is not on the list.
Which name would you give to a group that
contains the following websites...
43. HOME: menus and pulldowns | CARD SORTING
P叩ginas da Vida soap opera, Casseta e Planeta comedy
programme, Mais Voc棚 programme, Jornal Nacional
news programme, Esporte espetacular sports
programme etc
Presented alternatives * Most voted alternative
News: 0 votes * Correct alternative
* * Globo TV: 10 votes
Variety: 5 votes
Entertainment: 1 vote
Other programmes: 0 votes
Suggested labels
Day schedule
Matching with the correct alternative
Around 59%
44. HOME: menus and pulldowns | CARD SORTING
P叩ginas da Vida soap opera, Casseta e Planeta comedy
programme, Mais Voc棚 programme, Jornal Nacional
news programme, Esporte espetacular sports
programme etc
5-vote difference to the 2尊 place.
Although the correct alternative was the most voted, we noticed it was not
totally clear to the participants. Many of them take Globo TV for the Globo
Organisation in general.
The second placed alternative, "Variety, is too generic and would fit any
situation.
Recommendation
To keep the Globo TV label.
Despite the mix up with the Globo Organisation, it works well as a
group for the information search.
45. HOME: menus and pulldowns | CARD SORTING
Jornal Nacional, RJ TV, Bom dia Brasil,
Jornal Hoje etc
Presented alternatives
News: 3 votes * Most voted alternative
Other programmes: 0 votes * Correct alternative
* * TV News Programmes: 13 votes
+ TV: 0 votes
News Section: 1 vote
Suggested labels
None of the participants suggested other label.
Matching with the correct alternative
Around 76%
46. HOME: menus and pulldowns | CARD SORTING
Jornal Nacional, RJ TV, Bom dia Brasil,
Jornal Hoje etc
10-vote difference to the 2尊 place.
All of the alternatives voted are related to the same concept: TV News
Programmes, News, News Section; this proves that the participants
understood the items on the statement and made a conscious choice.
Recommendation
To keep the TV News Programmes label .
The meaning is well understood and the name is familiar because of
the TV.
47. HOME: menus and pulldowns | CARD SORTING
Ringtones, poca Magazine, Radio Globo FM, O Globo
Classified Ads, Cazuza the movie, Extra online etc
Presented alternatives
Globo TV: 0 votes * Most voted alternative
* * Other media: 11 votes * Correct alternative
Variety: 6 votes
Entertainment: 0 votes
Suggested labels
None of the participants suggested other label.
Matching with the correct alternative
Around 65%
48. HOME: menus and pulldowns | CARD SORTING
Ringtones, poca Magazine, Radio Globo FM, O Globo
Classified Ads, Cazuza the movie, Extra online etc
5-vote difference to the 2尊 place.
Only two alternatives were voted: Other media and Variety.
Participants understood the meaning of the term.
Note that they prefered to choose Other media rather than Variety, which
in theory can encopass every kind of content.
Recommendation
To keep the label Other media.
49. HOME: menus and pulldowns | CARD SORTING
Altas Horas, Programa do J担, Doming達o do Faust達o,
Caldeir達o do Huck, Video Show etc
Presented alternatives
* Other programmes: 1 vote * Most voted alternative
* Entertainment: 13 votes * Correct alternative
Journalism: 0 vote
+ TV: 1 vote
Other media: 0 vote
Suggested labels
Variety, Globo TV.
Matching with the correct alternative
Irrelevant (around 5%)
50. HOME: menus and pulldowns | CARD SORTING
Altas Horas, Programa do J担, Doming達o do Faust達o,
Caldeir達o do Huck, Video Show etc
76% of the participants voted for the alternative Entertainment.
All of the items used on the statement are related to Entertainment, which
might have interfered on the results of this question.
Recommendation
To keep the label Other programmes.
Even though the result of this activity does not corroborate this recommendation... We
verified previously that the group Other programmes presents high level of
agreement (79%) and as long as the items are also acessible through Entertainment,
there is no problem in keeping the existence of Other programmes.
To keep the presented items also in the Entertainment group, which
obtained 76% of the votes in this activity.
52. HOME: menus and pulldowns | CARD SORTING
Perception about the current Globo.com
Everything is restricted to subscribers
It restrains too much, you need a
password for everything
Too much information mixed up,
confusing
Theres a lot of stuff mixed up,
they could break it up in a better way
Its poluted
Confusion between Globo.com,
Globo Online, Globo TV
I think Globo has too many
news websites
53. HOME: menus and pulldowns | CARD SORTING
Suggestions
More content to non-subscribers
It was a recurring complain from all of the participants.
What is Globo.coms position?
They want to keep or change this perception?
Culture / Culture listings
Another recurring complain.
Theres only gossip, theres no culture, cinema, museum, theatre
News for youngsters
Group A, made up of teenagers, suggested this item.
Theres stuff for kids and for adults, but not for us
News about health (Healthy lifestyle, How to live well)
A participant of group C, from the health sector, noticed there was no
information about health and missed it.
55. HOME: menus and pulldowns | CARD SORTING
1) Duplication of items
To consider the duplication of items with dubious classification
in different categories.
Examples:
Openings Blog (it is in News but was placed in Entertainment 100% of the
times)
Fant叩stico programme
Linha Direta programme
Check other cases on the grouping spreadsheets.
56. HOME: menus and pulldowns | CARD SORTING
2) Search
The Search tool is very important as many users prefer to do
all of the navigation on the site through the Search.
- It must work properly
- It must be put in a place of easy access
57. HOME: menus and pulldowns | CARD SORTING
3) Fant叩stico programme
To consider the possibility of duplicating the item in the
Entertainment category.
It is currently in News.
65% of the participants placed the item in
Entertainment during the closed sorting.
If there was no Globo TV group,
47% would search in Entertainment during
the information search.
58. HOME: menus and pulldowns | CARD SORTING
4) Linha direta programme
To consider the possibility of duplicating the item in the
Entertainment category.
It is currently in News.
65% of the participants placed the item in
Entertainment during the closed sorting.
If there was no Globo TV group, 60% would search in
Entertainment during the information search.
59. HOME: menus and pulldowns | CARD SORTING
5) Children group
To consider the possibility of creating a Children group
gathering the relevant continent.
During the open sorting 60% of the participants created a
Children group.
60. HOME: menus and pulldowns | CARD SORTING
6) Produtised names and
unfamilair acronyms
- They generally cause understanding problems
- To avoid produtised names and incomprehensible
acronyms
- If there is no other way, to use at least a website
description next to the name whenever possible
Examples
G1, Planeta Bizarro, Ego, Kibe Loco, Babalorichat,
Caneladas, Cartola FC, Porrada, PEGN, LIESA
61. HOME: menus and pulldowns | CARD SORTING
7) More Culture
To make more Culture related content available.
Participants complained that
Theres only gossip, theres no culture, cinema, museum,
theatre.
62. HOME: menus and pulldowns | CARD SORTING
8) Restricted content
Participants complained that you need a password for
everything and for that reason end up giving up acessing the
website.
Is this how Globo.com want to come across as to the users?
Is there a position about this issue?
63. ATTENTION
Those involved in the project, especially the
information achitects in charge, should refer
to the complete documentation with the
results of the Card sorting, available at
glb12corp_criacao
10_laboratorio_de_usabilidade
5_card_sorting
2007_05_home
05_compilacao-de-dados