Using Customized Descriptive Codes and Text Analysis to Measure Service Process and Enhance Value in Virtual Reference

Jun 21, 2012Download as PPTX, PDF0 likes312 views

Poster presented at ALA 2012 Annual Conference describing framework and results of assessment of the MSU Libraries' virtual reference services.

Using Customized Descriptive Codes and Text Analysis
to Measure Service Process and Enhance Value in Virtual Reference
Christine Tobias - Reference & Technology Librarian - Michigan State University Libraries

Service Process: Text Analysis: Virtual reference IS a valuable
Why is virtual reference used? How are information needs expressed research service point!!
 In September 2010, a long-term assessment
in virtual reference?
Customized Descriptive Codes by Category
plan was implemented to quantitatively
measure service process in virtual reference. I am trying to I’m just getting my feet
 Customized descriptive codes were created get to CINAHL wet. Maybe you could
and defined in QuestionPoint, a web-based and I don’t suggest a starting point? Is there no way to
virtual reference software. know how to just search across
Library Resources
get there all the journals?
 Each question is assigned up to 3 codes based Library Services
from here. Technology Help
upon the initial question asked. Local Resources
 3,550 descriptive codes were assigned How do I search for scholarly
How do I use
articles?? I linked through google
between May 2011–April 2012.
scholar to see what materials can be intralibrary loan on
the website?
Enhance Value:
accessed through the library and it
sends me to [URL] and I do not know Improve the user experience
Measuring Service Process in Virtual Reference:
Most Frequently Assigned Customized Descriptive Codes
where to go from there. in virtual reference!
Research Question  Majority of questions received in
Librarian: Is this the catalog
Articles: Specific Journal/Citation virtual reference pertain to
record you viewed?
I can find the journal Patron: Well, I went through finding, accessing, and using
Electronic Resources
issue and the article. the e-resources page, but it’s library resources for research.
Book/Document Search But I can’t find any way the same information, yes.  Increase the transparency in
to actually access the
Databases
presentation of library resources
article, to get to the PDF
or whatever. in the digital environment.
Ready Reference
 Simplify website navigation and
Journal Holdings content to increase findability of
Circulation
library resources.
 A systematic sample of 355 transcripts from May 2011-April  Staff with librarians who will treat
Public Services
2012 were reviewed. virtual reference as a valuable
Citation Help  Specific words and phrases used to convey information needs research service point to ensure
0 100 200 300 400 500 600 700
identified pain points in the virtual research experience. service quality.
Copyright 2012 Christine L. Tobias. All rights reserved.

Here are some key skills needed by the digitally literate researcher: - Ability to effectively search for and evaluate digital resources and content - Proficiency with digital tools for collaboration, communication, project management - Skills in publishing, curating, and managing digital scholarly content and projects - Understanding of digital literacy issues like copyright, licensing, accessibility - Capacity to use digital tools and platforms for fieldwork, data collection and analysis - Competence in selecting appropriate digital tools and platforms for different contexts - Comfort adapting to emerging technologies and digital scholarly practices

UAB 2011- Combining human and computational intelligenceINSEMTIVES project

��

1. The document discusses challenges in semantic annotation and summarization including helping users understand semantic annotations, extracting annotations from contexts, and ensuring quality of service for semantics-enabled services. 2. It proposes using one word summaries generated from a knowledge base to help users understand the intended meaning of annotations. 3. Evaluation results show the meaning summarization approach achieves up to 63% precision in determining if two words have the same meaning in a given context.

Program for Library Information Service Provision to Groups of People with Sp...Glob@l Libraries - Bulgaria Program

��

The Nikola Furnadzhiev District Library in Pazardzhik, Bulgaria implemented a program in 1995-1996 to provide library and information services to people with special needs. [1] The program served seven groups with special needs through both stationary and non-stationary services. [2] The library collaborated with organizations supporting people with special needs and used a wide range of traditional and modern resources. [3]

Listen observe ux_dlsChristine Tobias

��

This document discusses methods for evaluating and enhancing the user experience (UX) of distance library services through evidence-based assessment. It begins by defining distance learning library services and principles of access entitlement. Usage analytics of guides, Google Analytics, and transaction logs provide quantitative evidence of student needs and pain points. Qualitative evidence from transcripts of virtual reference questions help identify areas of confusion. A mixed methods approach is advocated to understand why and where users struggle in order to improve services and transparency of resources. Librarians are encouraged to listen, observe and evaluate their own services to enhance the UX for distance learners.

What's New in Titanium 1.5Kevin Whinnery

��

This document summarizes the new features of Appcelerator Titanium Mobile 1.5, including enhancements for Android and iOS, new styling options with JavaScript Style Sheets, improved localization support, better handling of screen densities and orientations, improved native component integration for Android, and performance improvements for table views. It also announces additional upcoming training on native Android features and cross-platform development best practices.

Cooperative Virtual Reference Assessment: Service Process, Service Quality, a...Christine Tobias

��

Gustavo cardoso in3 jan2011_aGustavo Cardoso

��

This document discusses the changing nature of communication and media consumption in the digital age. It argues that we have moved beyond mass communication models to a state of "networked communication" where people are both producers and consumers of media. Participants now play a central role as distributors, innovators, and classifiers of information. When people remix and share content using various tools, the message becomes defined by the people rather than the media itself. Communication is increasingly networked, with people, not media, at the center.

Tech Tools: Simplifying Life for Busy Research LibrariansChristine Tobias

��

Developing a digital literacy framework in your schoolEduwebinar

��

Virtual embeddingFowler Susan

��

Virtual embedding of library resources and services has evolved from physical embedding within institutions to virtual embedding within online environments used by patrons. A review found libraries have embedded resources like reading lists and link resolvers within course management systems and department websites. Services like reference and interlibrary loan have been provided via email, phone and chat. Moving forward, the review suggests embedding more library services directly within electronic medical records, mobile apps, internal networks and databases through tools like buttons and search filters to reach patrons virtually. The future may include librarians embedded using communication tools like Twitter, Facebook and instant messaging to help patrons within their own online spaces.

Corrall & Dove - Web scale discovery and information literacy: competing visi...IL Group (CILIP Information Literacy Group)

��

This document discusses web scale discovery services and information literacy. It begins by providing context about the social, economic, technological, and political factors driving changes in libraries. It then describes perceptions of libraries and information literacy skills students need. Next, it outlines features of next generation discovery services and their potential pros and cons. Specifically, it notes discovery services make access easier but may diminish search skills. The document concludes by questioning if discovery services compete with or support information literacy goals of teaching students to find, evaluate, and use information effectively.

Academics' online presence - assessing & shaping visibility 2012Laura Czerniewicz

��

This document discusses ways for academics to maximize their online presence and visibility. It recommends assessing one's current online footprint and digital shadow through regular Google searches and alerts. It suggests improving profiles on sites like Academia.edu, LinkedIn, and one's institution page. The document also recommends making scholarly works openly accessible by self-archiving, using repositories, and publishing in open access journals. Other tips include using social bookmarking sites, academic communities, blogging, and Twitter to connect and communicate with other scholars. The overall goal is to broadly share one's work online to increase citations and scholarly impact.

Technological Advances in Reference WorkPhilippine Association of Academic/Research Librarians

��

Virtual reference service myrnaPAQUIAAIZEL

��

Trends in reference services show decreased in-person library usage and circulation statistics, with more users relying on search engines and digital resources. This has led libraries to reduce reference desk hours and staffing levels. Virtual reference services have emerged to provide reference assistance online through tools like email, chat, video conferencing and voice over IP. These services allow users to get help remotely through synchronous and asynchronous methods. Popular virtual reference platforms include QuestionPoint, Skype and Google Talk.

Managing your library's online presenceSuhui Ho

��

Smxeastbarbarastarr2012Barbara Starr

��

This document discusses the importance of metadata from a search engine perspective. It outlines how search engines have evolved to make use of metadata over time, from directly extracting metadata to enhance search results, to being able to search metadata directly and provide direct answers to queries. The document also notes that metadata adoption on the web has increased over time, with around 31% of webpages and 5% of domains now containing some metadata, primarily in the form of RDFa. Metadata allows search engines to better understand and organize content to provide more relevant search results.

Scaling Organizational Capacity to Meet E-Resources Needs: Centralize or Dece...Electronic Resources & Libraries

��

Presented at the 2010 Electronic Resources & Libraries Conference. Abstract: As emphasis shifts from print to electronic, a library's organizational capacity or ability to manage workloads with sufficient numbers and levels is strained. R2 Consulting comments on the most salient trends and recommendations regarding library operations. University of Colorado Denver Auraria Library provides local examples of reinventing staffing and workflow.

Scaling Organizational Capacity to Meet E-Resources Needs: Centralize or Dece...Electronic Resources & Libraries

��

This document discusses options for structuring an organization to effectively manage electronic resources. It suggests that e-resources have become the mainstream activity for technical services but that organizational structures and priorities often do not reflect this reality. The document examines the skills, tools, and workflows needed for e-resources management and considers whether to take a centralized or decentralized organizational approach. It provides recommendations for libraries to recognize e-resources as the priority, expand e-resources staffing levels, and integrate e-resources tasks into mainstream workflows.

Embedded Librarians and Faculty Collaborate to Dish Out Information Literacy ...Higher Education Institution

��

Serve it up! Embedded Librarians and Faculty Collaborate to Dish Out Information Literacy Skills The Distance Education Campus at Mohave Community College in Mohave County, AZ, created a unique partnership with Academic Library Services to provide online students with "point of need" information literacy skills in a classroom without walls environment. The presenters will talk about their collaborative experience with the embedded librarian pilot. Tips for a successful collaboration will be included. . --------------------------------------------------------------------------------

Academic visibility online presentation 13 october 2011Laura Czerniewicz

��

2011Embedded Libraians and Faculty CollaborateWCET

��

1. Embedded librarians in online courses to provide point-of-need research assistance to distant students. 2. Assessed the pilot's success through pre- and post-tests showing a 58% to 94% improvement in students' research abilities. 3. Identified opportunities to strengthen the program, such as establishing assignment deadlines and timely grading to emphasize the importance of information literacy skills development.

Katalog dan Pengatalog: tantangan kini dan masa depanhendrowicaksonogmailcom

��

The document discusses the challenges of cataloging and metadata today and in the future, including changes in technology, user behavior, and the types of information objects that need to be described. It provides biographical information about Hendro Wicaksono and his experience working in libraries and developing cataloging systems. The document touches on the evolving nature of libraries, catalogs, metadata standards, and the tasks and skills needed for cataloging in the digital age.

Integrating digital traces into a semantic enriched dataDhaval Thakker

��

The document discusses integrating digital traces from social media into a semantic-enriched data cloud for informal learning. It outlines a processing pipeline that collects digital traces, semantically augments them using ontologies, and allows browsing and interaction through a semantic query service. An exploratory study on job interviews found that authentic examples from digital traces were useful learning stimuli but could be mistaken as norms without context. Semantic technologies provide opportunities to organize digital traces for informal learning but further work is needed to fully realize this potential.

Webscale discovery and information literacyli1smc

��

The document discusses web scale discovery tools and their relationship to information literacy. It provides context on the social, economic, technological, and political factors driving adoption of these tools. It then examines perceptions of libraries and describes various commercial and open source discovery services. Desired features of discovery services and early experiences with them are outlined. However, the document notes tensions between a resource-based view of libraries versus an information literacy view. It poses four questions for debate around how well discovery tools support student development of information literacy skills and the need to augment these tools to better deliver on libraries' information literacy mission.

Webscale Discovery and Information LiteracyCharleston Conference

��

The document discusses web scale discovery tools and their relationship to information literacy. It provides context on the social, economic, technological, and political factors driving adoption of these tools. It then examines perceptions of libraries and describes various commercial and open source discovery services. Desired features of discovery services are outlined. Early reports suggest discovery tools have increased usage of licensed resources but students struggle to interpret results. This raises implications for information literacy support. Challenges around balancing convenience with developing research skills are debated. The document concludes by posing four questions around how discovery tools can support information literacy goals.

Digital LibrarySmith Boonchutima

��

Introducing the Open Discovery InitiativeNASIG

��

1530 mon lomond breedingUKSG: connecting the knowledge community

��

The document discusses the emergence of web-scale library platforms that move away from locally-housed systems towards globally shared platforms. These new library services platforms offer opportunities for libraries to operate less in isolated silos and more within broad, web-scale environments of highly shared data and unified workflows across physical, digital, and electronic collections. Discovery services have led the way towards this web-scale approach, and library management systems are now following a similar path.

Crafting Winning STEM & Science Grant ProposalsKevin Welch

��

UTI Quinolones by Mrs. Manjushri DabhadeDabhade madam Dabhade

��

More Related Content

Similar to Using Customized Descriptive Codes and Text Analysis to Measure Service Process and Enhance Value in Virtual Reference (20)

Developing a digital literacy framework in your schoolEduwebinar

��

Virtual embeddingFowler Susan

��

Corrall & Dove - Web scale discovery and information literacy: competing visi...IL Group (CILIP Information Literacy Group)

��

Academics' online presence - assessing & shaping visibility 2012Laura Czerniewicz

��

Technological Advances in Reference WorkPhilippine Association of Academic/Research Librarians

��

Virtual reference service myrnaPAQUIAAIZEL

��

Managing your library's online presenceSuhui Ho

��

Smxeastbarbarastarr2012Barbara Starr

��

Scaling Organizational Capacity to Meet E-Resources Needs: Centralize or Dece...Electronic Resources & Libraries

��

Scaling Organizational Capacity to Meet E-Resources Needs: Centralize or Dece...Electronic Resources & Libraries

��

Embedded Librarians and Faculty Collaborate to Dish Out Information Literacy ...Higher Education Institution

��

Academic visibility online presentation 13 october 2011Laura Czerniewicz

��

2011Embedded Libraians and Faculty CollaborateWCET

��

Katalog dan Pengatalog: tantangan kini dan masa depanhendrowicaksonogmailcom

��

Integrating digital traces into a semantic enriched dataDhaval Thakker

��

Webscale discovery and information literacyli1smc

��

Webscale Discovery and Information LiteracyCharleston Conference

��

The document discusses web scale discovery tools and their relationship to information literacy. It provides context on the social, economic, technological, and political factors driving adoption of these tools. It then examines perceptions of libraries and describes various commercial and open source discovery services. Desired features of discovery services are outlined. Early reports suggest discovery tools have increased usage of licensed resources but students struggle to interpret results. This raises implications for information literacy support. Challenges around balancing convenience with developing research skills are debated. The document concludes by posing four questions around how discovery tools can support information literacy goals.

Digital LibrarySmith Boonchutima

��

Introducing the Open Discovery InitiativeNASIG

��

1530 mon lomond breedingUKSG: connecting the knowledge community

��

Developing a digital literacy framework in your schoolEduwebinar

��

Virtual embeddingFowler Susan

��

Corrall & Dove - Web scale discovery and information literacy: competing visi...IL Group (CILIP Information Literacy Group)

��

Academics' online presence - assessing & shaping visibility 2012Laura Czerniewicz

��

Technological Advances in Reference WorkPhilippine Association of Academic/Research Librarians

��

Virtual reference service myrnaPAQUIAAIZEL

��

Managing your library's online presenceSuhui Ho

��

Smxeastbarbarastarr2012Barbara Starr

��

Scaling Organizational Capacity to Meet E-Resources Needs: Centralize or Dece...Electronic Resources & Libraries

��

Scaling Organizational Capacity to Meet E-Resources Needs: Centralize or Dece...Electronic Resources & Libraries

��

Embedded Librarians and Faculty Collaborate to Dish Out Information Literacy ...Higher Education Institution

��

Academic visibility online presentation 13 october 2011Laura Czerniewicz

��

2011Embedded Libraians and Faculty CollaborateWCET

��

Katalog dan Pengatalog: tantangan kini dan masa depanhendrowicaksonogmailcom

��

Integrating digital traces into a semantic enriched dataDhaval Thakker

��

Webscale discovery and information literacyli1smc

��

Webscale Discovery and Information LiteracyCharleston Conference

��

Digital LibrarySmith Boonchutima

��

Introducing the Open Discovery InitiativeNASIG

��

1530 mon lomond breedingUKSG: connecting the knowledge community

��

Recently uploaded (20)

Crafting Winning STEM & Science Grant ProposalsKevin Welch

��

UTI Quinolones by Mrs. Manjushri DabhadeDabhade madam Dabhade

��

MIPLM subject matter expert Daniel HolznerMIPLM

��

Unit 3: Combustion in Spark Ignition EnginesNileshKumbhar21

��

Sulfonamides by Mrs. Manjushri P. DabhadeDabhade madam Dabhade

��

Yale VMOC Special Report - Measles Outbreak Southwest US 3-30-2025 FINAL v2...Yale School of Public Health - The Virtual Medical Operations Center (VMOC)

��

MIPLM subject matter expert Nicos RaftisMIPLM

��

DUODENUM ANATOMY & Clinical Anatomy.pptxSid Roy

��

Personal Brand exploration powerpoint pp1rayvoisine3

��

STOMACH Gross Anatomy & Clinical Anatomy.pptxSid Roy

��

Anti-Viral Agents.pptx Medicinal Chemistry III, B Pharm SEM VISamruddhi Khonde

��

Antiviral agents are crucial in combating viral infections, causing a variety of diseases from mild to life-threatening. Developed through medicinal chemistry, these drugs target viral structures and processes while minimizing harm to host cells. Viruses are classified into DNA and RNA viruses, with each replicating through distinct mechanisms. Treatments for herpesviruses involve nucleoside analogs like acyclovir and valacyclovir, which inhibit the viral DNA polymerase. Influenza is managed with neuraminidase inhibitors like oseltamivir and zanamivir, which prevent the release of new viral particles. HIV is treated with a combination of antiretroviral drugs targeting various stages of the viral life cycle. Hepatitis B and C are treated with different strategies, with nucleoside analogs like lamivudine inhibiting viral replication and direct-acting antivirals targeting the viral RNA polymerase and other key proteins. Antiviral agents are designed based on their mechanisms of action, with several categories including nucleoside and nucleotide analogs, protease inhibitors, neuraminidase inhibitors, reverse transcriptase inhibitors, and integrase inhibitors. The design of these agents often relies on understanding the structure-activity relationship (SAR), which involves modifying the chemical structure of compounds to enhance efficacy, selectivity, and bioavailability while reducing side effects. Despite their success, challenges such as drug resistance, viral mutation, and the need for long-term therapy remain.

COMMON HEALTH PROBLEMS INCLUDING COMMUNICABLES AND NON COMMUNICABLE DISEASESSonaliGupta630281

��

The basics of sentences session 9pptx.pptxheathfieldcps1

��

Pain, Types, Natureof Pain, Management, .pptxAbhijeet Mahale

��

Precise guide for GNM/RGNM, B.Sc. Nursing/Basic B.Sc. Nursing & M.Sc Nursing students ... Regarding pain and its management. Highly recommended for Third Semester B.Sc Nursing Students . Also this document discusses pain management through both non-pharmacological and pharmacological approaches. It covers typical areas of referred pain, pain assessment techniques, non-drug therapies like recreation and different approaches for using analgesic medications.

The basics of sentences session 10pptx.pptxheathfieldcps1

��

Karin Clavel - Collection Wall: Inspiring connection and collaborationvoginip

��

U.S. Department of Education certificationMebane Rash

��

Berry_Kanisha_BAS_PB1_202503 (2) (2).pdfKanishaBerry

��

📣 Marketing is Everything in the Beauty Business! 💅🏾✨ Talent gets you in the ...coreylewis960

��

📣 Marketing is Everything in the Beauty Business! 💅🏾✨ Talent gets you in the game—but visibility keeps your chair full. Today’s top stylists aren’t just skilled—they’re seen. That’s where MyFi Beauty comes in. 🌟 We Help You Get Noticed with Tools That Work: 📱 Social Media Scheduling & Strategy We make it easy for you to stay consistent and on-brand across Instagram, Facebook, TikTok, and more. You’ll get content prompts, captions, and posting tools that do the work while you do the hair. 🖥️ Your Own Personal Beauty App Stand out from the crowd with a custom app made just for you. Clients can: Book appointments Browse your services View your gallery Join your email/text list Leave reviews & refer friends 🖼️ Offline Marketing Made Easy We provide digital flyers, QR codes, and branded business cards that connect straight to your app—turning strangers into loyal clients with just one tap. 🎯 The Result? You build a strong personal brand that reaches more people, books more clients, and grows with you. Whether you’re just starting out or trying to level up—MyFi Beauty is your silent partner in success.

VTU notes for Indian Knowledge System 2022 scheme pptSuvarna Hiremath

��

Crafting Winning STEM & Science Grant ProposalsKevin Welch

��

UTI Quinolones by Mrs. Manjushri DabhadeDabhade madam Dabhade

��

MIPLM subject matter expert Daniel HolznerMIPLM

��

Unit 3: Combustion in Spark Ignition EnginesNileshKumbhar21

��

Sulfonamides by Mrs. Manjushri P. DabhadeDabhade madam Dabhade

��

Yale VMOC Special Report - Measles Outbreak Southwest US 3-30-2025 FINAL v2...Yale School of Public Health - The Virtual Medical Operations Center (VMOC)

��

MIPLM subject matter expert Nicos RaftisMIPLM

��

DUODENUM ANATOMY & Clinical Anatomy.pptxSid Roy

��

Personal Brand exploration powerpoint pp1rayvoisine3

��

STOMACH Gross Anatomy & Clinical Anatomy.pptxSid Roy

��

Anti-Viral Agents.pptx Medicinal Chemistry III, B Pharm SEM VISamruddhi Khonde

��

COMMON HEALTH PROBLEMS INCLUDING COMMUNICABLES AND NON COMMUNICABLE DISEASESSonaliGupta630281

��

The basics of sentences session 9pptx.pptxheathfieldcps1

��

Pain, Types, Natureof Pain, Management, .pptxAbhijeet Mahale

��

The basics of sentences session 10pptx.pptxheathfieldcps1

��

Karin Clavel - Collection Wall: Inspiring connection and collaborationvoginip

��

U.S. Department of Education certificationMebane Rash

��

Berry_Kanisha_BAS_PB1_202503 (2) (2).pdfKanishaBerry

��

📣 Marketing is Everything in the Beauty Business! 💅🏾✨ Talent gets you in the ...coreylewis960

��

VTU notes for Indian Knowledge System 2022 scheme pptSuvarna Hiremath

��

Using Customized Descriptive Codes and Text Analysis to Measure Service Process and Enhance Value in Virtual Reference

1. Using Customized Descriptive Codes and Text Analysis to Measure Service Process and Enhance Value in Virtual Reference Christine Tobias - Reference & Technology Librarian - Michigan State University Libraries Service Process: Text Analysis: Virtual reference IS a valuable Why is virtual reference used? How are information needs expressed research service point!!  In September 2010, a long-term assessment in virtual reference? Customized Descriptive Codes by Category plan was implemented to quantitatively measure service process in virtual reference. I am trying to I’m just getting my feet  Customized descriptive codes were created get to CINAHL wet. Maybe you could and defined in QuestionPoint, a web-based and I don’t suggest a starting point? Is there no way to virtual reference software. know how to just search across Library Resources get there all the journals?  Each question is assigned up to 3 codes based Library Services from here. Technology Help upon the initial question asked. Local Resources  3,550 descriptive codes were assigned How do I search for scholarly How do I use articles?? I linked through google between May 2011–April 2012. scholar to see what materials can be intralibrary loan on the website? Enhance Value: accessed through the library and it sends me to [URL] and I do not know Improve the user experience Measuring Service Process in Virtual Reference: Most Frequently Assigned Customized Descriptive Codes where to go from there. in virtual reference! Research Question  Majority of questions received in Librarian: Is this the catalog Articles: Specific Journal/Citation virtual reference pertain to record you viewed? I can find the journal Patron: Well, I went through finding, accessing, and using Electronic Resources issue and the article. the e-resources page, but it’s library resources for research. Book/Document Search But I can’t find any way the same information, yes.  Increase the transparency in to actually access the Databases presentation of library resources article, to get to the PDF or whatever. in the digital environment. Ready Reference  Simplify website navigation and Journal Holdings content to increase findability of Circulation library resources.  A systematic sample of 355 transcripts from May 2011-April  Staff with librarians who will treat Public Services 2012 were reviewed. virtual reference as a valuable Citation Help  Specific words and phrases used to convey information needs research service point to ensure 0 100 200 300 400 500 600 700 identified pain points in the virtual research experience. service quality. Copyright 2012 Christine L. Tobias. All rights reserved.

�ݺ�ߣ

Using Customized Descriptive Codes and Text Analysis to Measure Service Process and Enhance Value in Virtual Reference

Recommended

More Related Content

Similar to Using Customized Descriptive Codes and Text Analysis to Measure Service Process and Enhance Value in Virtual Reference (20)

Recently uploaded (20)

Using Customized Descriptive Codes and Text Analysis to Measure Service Process and Enhance Value in Virtual Reference