Recommender Systems in E-Commerce J. Ben Schafer, Joseph Konstan, John Riedl GroupLens Research Project Department of Computer Science and Engineering University of Minnesota Minneapolis, MN 55455 1-612-625-4002 (schafer, konstan, riedl @cs. umn. edu ABSTRACT their needs. One solution to this information overload problem is the use of recommender systems Recommender systems are changing from novelties used by a few E-commerce sites, to serious business tools that are re-shaping Recommender systems are used by E-commerce sites to suggest the world of E-commerce. Many of the largest commerce Web products to their customers. The products can be recommended sites are already using recommender systems to help their based on the top overall sellers on a site, based on the customers find products to purchase. A recommender system demographics of the customer, or based on an analysis of the past learns from a customer and recommends products that she will buying behavior of the customer as a prediction for future buying find most valuable from among the available products. In this behavior. Broadly, these techniques are part of personalization paper we present an explanation of how recommender systems n a site, because they help the site adapt itself to each customer Ip E-commerce sites increase sales, and analyze six sites that Recommender systems automate personalization on the Web, use recommender systems including several sites that use more enabling individual personalization for each customer than one recommender system. Based on the examples, we Personalization to this extent is one way to realize Pines ideas create a taxonomy of recommender systems, including the on the Web. Thus, Pine would probably agree with Jeff Bezos, terraces they present to customers, the technologies used to cEO of Amazon comM when he said "If I have 2 millio eate the recommendations, and the inputs they need from customers on the Web. i should have 2 million stores on the customers. We conclude with ideas for new applications of Web recommender systems to E-commerce Recommender systems enhance E-commerce sales in three ways Keywords Browsers into buyers: Visitors to a Web site often look over the Electronic commerce, recommender systems, interface, customer site without ever purchasing anything Recommender systems loyalty, cross-sell, up-sell, mass customization. can help customers find products they wish to purchase Cross-sell: Recommender systems improve cross-sell by 1. NTRODUCTION suggesting additional products for the customer to purchase. If In his book Mass Customization(Pine, 1993), Joe the recommendations are good, the average order size should need to shift from the old worl s increase. For instance, a site might recommend additi oduction where"standardized products, homogene products in the checkout process, based on those products alre and long product life and development cycles were the rule"to pping cart the new world where " variety and customization supplant Loyalty: In a world where a site s competitors are only a click or standardized products. Pine argues that building one product is two away, gaining customer loyalty is an essential business simply not adequate anymore. Companies need to be able to, at minimum, develop multiple products that meet the multiple strategy (Reichheld and Sesser, 1990)(Reichheld, 1993) Recommende needs of multiple customers. The movement toward E-commerce relationship between the site and the customer. Sites invest in has allowed companies to provide customers with more options However, in expanding to this new level of customization, learning about their users, use recommender systems to businesses increase the amount of information that customers perationalize that learning, and present custom interfaces that must process before they are able to select which items meet match customer needs. Customers repay these sites by returning to the ones that best match their needs The more a custome uses the recommendation system - teaching it what they want the more loyal they are to the site. "Even if a competitor were to build the exact same capabilities, a customer. would have to spend an inordinate amount of time and energy teaching the competitor what the company already knows. (Pine, et al. 1995) Finally, creating relationships between customers can also increase loyalty the site that recommends people with whom they will like to interact
Recommender Systems in E-Commerce J. Ben Schafer, Joseph Konstan, John Riedl GroupLens Research Project Department of Computer Science and Engineering University of Minnesota Minneapolis, MN 55455 1-612-625-4002 {schafer, konstan, riedl}@cs.umn.edu ABSTRACT Recommender systems are changing from novelties used by a few E-commerce sites, to serious business tools that are re-shaping the world of E-commerce. Many of the largest commerce Web sites are already using recommender systems to help their customers find products to purchase. A recommender system learns from a customer and recommends products that she will find most valuable from among the available products. In this paper we present an explanation of how recommender systems help E-commerce sites increase sales, and analyze six sites that use recommender systems including several sites that use more than one recommender system. Based on the examples, we create a taxonomy of recommender systems, including the interfaces they present to customers, the technologies used to create the recommendations, and the inputs they need from customers. We conclude with ideas for new applications of recommender systems to E-commerce. Keywords Electronic commerce, recommender systems, interface, customer loyalty, cross-sell, up-sell, mass customization. 1. INTRODUCTION In his book Mass Customization (Pine, 1993), Joe Pine argues that companies need to shift from the old world of mass production where “standardized products, homogeneous markets, and long product life and development cycles were the rule” to the new world where “variety and customization supplant standardized products.” Pine argues that building one product is simply not adequate anymore. Companies need to be able to, at a minimum, develop multiple products that meet the multiple needs of multiple customers. The movement toward E-commerce has allowed companies to provide customers with more options. However, in expanding to this new level of customization, businesses increase the amount of information that customers must process before they are able to select which items meet their needs. One solution to this information overload problem is the use of recommender systems. Recommender systems are used by E-commerce sites to suggest products to their customers. The products can be recommended based on the top overall sellers on a site, based on the demographics of the customer, or based on an analysis of the past buying behavior of the customer as a prediction for future buying behavior. Broadly, these techniques are part of personalization on a site, because they help the site adapt itself to each customer. Recommender systems automate personalization on the Web, enabling individual personalization for each customer. Personalization to this extent is one way to realize Pine’s ideas on the Web. Thus, Pine would probably agree with Jeff Bezos, CEO of Amazon.com™ , when he said “If I have 2 million customers on the Web, I should have 2 million stores on the Web.” Recommender systems enhance E-commerce sales in three ways: Browsers into buyers: Visitors to a Web site often look over the site without ever purchasing anything. Recommender systems can help customers find products they wish to purchase. Cross-sell: Recommender systems improve cross-sell by suggesting additional products for the customer to purchase. If the recommendations are good, the average order size should increase. For instance, a site might recommend additional products in the checkout process, based on those products already in the shopping cart. Loyalty: In a world where a site’s competitors are only a click or two away, gaining customer loyalty is an essential business strategy (Reichheld and Sesser, 1990) (Reichheld, 1993). Recommender systems improve loyalty by creating a value-added relationship between the site and the customer. Sites invest in learning about their users, use recommender systems to operationalize that learning, and present custom interfaces that match customer needs. Customers repay these sites by returning to the ones that best match their needs. The more a customer uses the recommendation system – teaching it what they want – the more loyal they are to the site. “Even if a competitor were to build the exact same capabilities, a customer … would have to spend an inordinate amount of time and energy teaching the competitor what the company already knows.” (Pine, et al. 1995) Finally, creating relationships between customers can also increase loyalty. Customers will return to the site that recommends people with whom they will like to interact
This paper makes five contributions to the understanding of Amazon. com Delivers: Amazon. com Delivers is a variation on recommender systems in E-commerce. First, we provide a set of the Eyes feature. Customers select checkboxes to choose from a recommender system examples that span the range of different list of specific categories/genres (Oprah books, biographies, applications of recommender systems in E-commerce. Second, cooking). Periodically the editors at Amazon. com send email we analyze the way in which each of the examples uses the announcements to notify subscribers of their latest recommender system to enhance revenue on the site. Third, we recommendations in the subscribed categor describe a mapping from applications of recommender systems to Book Matcher: The book Matcher feature allows customers to a taxonomy of ways of implementing the applications. Fourth, we examine the effort required from give direct feedback about books they have read. Customers rate recommendations. Fifth, we describe a set of suggestions fo books they have read on a 5-point scale from"hated it" to"loved new recommender system applications based of our it. After rating a sample of books, customers may request recommendations for books they might like. At that point a half taxonomy that have not been explored by the existing dozen non-rated texts are presented which correlate with the applications user's indicated tastes. Feedback to these recommendations is aper is useful to two groups: academics studying provided by a"rate these books" feature where customers can mender systems in E-commerce, and implementers indicate a rating for one or more of the recommended books ering applying recommender systems in their site. For academics, the examples and taxonomies provide a useful initial Customer Comments: The Customer Comments feature allows framework within which their research can be placed. The of other customers. Located on the information page for each framework will undoubtedly be expanded to include future hook is a list of 1-5 star ratings and written comments provided applications of recommender systems. For implementers, the paper provides a way of making choices among the available by customers who have read the book in question and submitted a review. Customers have the option of incorporating these applications and technologies. An implementer can choose a recommendations into their purchase decision oneymaking goal, select the interfaces that will help achieve that goal, and select an implementation technique that supports 2.2 CDNOW the goal within the interface Album Advisor: The Album Advisor feature of CDNOWTM 2. Recommender system examples (www.cdnow.com)worksintwodifferentmodesInthesingle album mode customers locate the information page for a given In the following section we present six e-commerce businesses album. The system recommends 10 other albums related to the that utilize one or more variations of recommender system album in question. In the multiple artist mode customers enter we give a brief description of the features of the system. In later up to three artists. In turn, the system recommends 10 album recommendations provided, the type of technology used, and the My CDNOW: My CDNOW enables customers to set up their types of information gathered. For organizational purposes these ic store, based on albums and artists they like. sites have been alphabetized. The examples listed were correct Customers indicate which albums they own, and which artists are as of May 31, 1999. Due to the rapid changes in the Internet their favorites. Purchases from CDNOw are entered they may no longer be valid automatically into the " own it" list. Although"own it"ratings are initially treated as an indication of positive likes, customers 2.1 Amazon. com can go back and distinguish between "own it and like it" and We focus on recommender systems in the book section of"own it but dislike it. When customers request Amazon. com recommendations the system will predict 6 albums the custome Customers who Bought: Like many E-commerce site es might like based on what is already owned. A feedback option is Amazon.comm(www.amazon.comisstructuredwithan available by customers providing a " own it, "move to wish list information page for each book, giving details of the text and or"not for me comment for any of the albums in this prediction purchase information. The Customers who Bought feature is list. The albums recommended change based on the feedback. found on the information page for each book in their catalog. It 2.3 eBay recommends books frequently purchased by customers who FeedbackProfileTheFeedbackProfilefeatureatebAy.comtm purchased the selected book. The second recommends authors ebay. com) allows both buyers and sellers to contribute to whose books are frequently purchased feedback profiles of other customers with whom they have done purchased works by the author of the selected book. business. The feedback consists of a satisfaction rating (satisfied/neutral/dissatisfied) as well as a specific comment Eyes: The Eyes feature allows customers to be notified via about the other customer. Feedback is used to provide a email of new items added to the Amazon. com catalog recommender system for purchasers, who are able to view the ustomers enter requests based upon author, title, subject, ISBN, profile of sellers. This profile consists of a table of the number or publication date information. Customers can use both simple of each rating in the past 7 days, past month, and past 6 months, and more complex Boolean-base ed criteria (AND/OR)for well as an overall summary (e.g, 867 positives from 776 notification queries. Requests can also be directly entered from unique customers). Upon further request, customers can browse any search results screen, creating a persistent request based the individual ratings and comments for the sellers the search
This paper makes five contributions to the understanding of recommender systems in E-commerce. First, we provide a set of recommender system examples that span the range of different applications of recommender systems in E-commerce. Second, we analyze the way in which each of the examples uses the recommender system to enhance revenue on the site. Third, we describe a mapping from applications of recommender systems to a taxonomy of ways of implementing the applications. Fourth, we examine the effort required from users to find recommendations. Fifth, we describe a set of suggestions for new recommender system applications based on parts of our taxonomy that have not been explored by the existing applications. The paper is useful to two groups: academics studying recommender systems in E-commerce, and implementers considering applying recommender systems in their site. For academics, the examples and taxonomies provide a useful initial framework within which their research can be placed. The framework will undoubtedly be expanded to include future applications of recommender systems. For implementers, the paper provides a way of making choices among the available applications and technologies. An implementer can choose a moneymaking goal, select the interfaces that will help achieve that goal, and select an implementation technique that supports the goal within the interface. 2. Recommender System Examples In the following section we present six e-commerce businesses that utilize one or more variations of recommender system technology in their web sites. For each site, and each variation, we give a brief description of the features of the system. In later sections we refer to these examples as we explain the types of recommendations provided, the type of technology used, and the types of information gathered. For organizational purposes these sites have been alphabetized. The examples listed were correct as of May 31, 1999. Due to the rapid changes in the Internet they may no longer be valid. 2.1 Amazon.com We focus on recommender systems in the book section of Amazon.com. Customers who Bought: Like many E-commerce sites, Amazon.com™ (www.amazon.com) is structured with an information page for each book, giving details of the text and purchase information. The Customers who Bought feature is found on the information page for each book in their catalog. It is in fact two separate recommendation lists. The first recommends books frequently purchased by customers who purchased the selected book. The second recommends authors whose books are frequently purchased by customers who purchased works by the author of the selected book. Eyes: The Eyes feature allows customers to be notified via email of new items added to the Amazon.com catalog. Customers enter requests based upon author, title, subject, ISBN, or publication date information. Customers can use both simple and more complex Boolean-based criteria (AND/OR) for notification queries. Requests can also be directly entered from any search results screen, creating a persistent request based on the search. Amazon.com Delivers: Amazon.com Delivers is a variation on the Eyes feature. Customers select checkboxes to choose from a list of specific categories/genres (Oprah books, biographies, cooking). Periodically the editors at Amazon.com send email announcements to notify subscribers of their latest recommendations in the subscribed categories. Book Matcher: The Book Matcher feature allows customers to give direct feedback about books they have read. Customers rate books they have read on a 5-point scale from “hated it” to “loved it.” After rating a sample of books, customers may request recommendations for books they might like. At that point a half dozen non-rated texts are presented which correlate with the user’s indicated tastes. Feedback to these recommendations is provided by a “rate these books” feature where customers can indicate a rating for one or more of the recommended books. Customer Comments: The Customer Comments feature allows customers to receive text recommendations based on the opinions of other customers. Located on the information page for each book is a list of 1-5 star ratings and written comments provided by customers who have read the book in question and submitted a review. Customers have the option of incorporating these recommendations into their purchase decision. 2.2 CDNOW Album Advisor: The Album Advisor feature of CDNOW™ (www.cdnow.com) works in two different modes. In the single album mode customers locate the information page for a given album. The system recommends 10 other albums related to the album in question. In the multiple artist mode customers enter up to three artists. In turn, the system recommends 10 albums related to the artists in question. My CDNOW: My CDNOW enables customers to set up their own music store, based on albums and artists they like. Customers indicate which albums they own, and which artists are their favorites. Purchases from CDNOW are entered automatically into the “own it” list. Although “own it” ratings are initially treated as an indication of positive likes, customers can go back and distinguish between “own it and like it” and “own it but dislike it.” When customers request recommendations the system will predict 6 albums the customer might like based on what is already owned. A feedback option is available by customers providing a “own it,” “move to wish list” or “not for me” comment for any of the albums in this prediction list. The albums recommended change based on the feedback. 2.3 eBay Feedback Profile: The Feedback Profile feature at eBay.com™ (www.ebay.com) allows both buyers and sellers to contribute to feedback profiles of other customers with whom they have done business. The feedback consists of a satisfaction rating (satisfied/neutral/dissatisfied) as well as a specific comment about the other customer. Feedback is used to provide a recommender system for purchasers, who are able to view the profile of sellers. This profile consists of a table of the number of each rating in the past 7 days, past month, and past 6 months, as well as an overall summary (e.g., 867 positives from 776 unique customers). Upon further request, customers can browse the individual ratings and comments for the sellers
2. 4 Levis describes the recommendation technology used by the site, and Style Finder: Style Finder allows customers of the Levi the inputs required by that technology. The fourth column describes how users find recommendations using the application on articles of Levis clothing. Customers indicate whether they Each of the columns of Table I is the subject of one of the are male or female, then view three categories- Music, Looks Fun-and rate a minimum of 4"terms"or"sub-categories the table, and their role in supporting recommender systems for within each. They do this by providing a rating on a 7-point cale ranging trom leave it to "love it. They may also choose 3. Recommendation Interfaces and Ways to are entered customers may select "get recommendations."Here, Make Money they are provided with thumbnails of 6 items of recommended An old proverb states that there is "more than one way to skin a clothing. Customers may provide feedback by use of the"tell us cat. One would assume that the method selected depends on the what you think feature"which allows them to enter an opinion desired outcome. Similarly, there is more than one way to rating for the recommended article of clothing. Feedback may display recommendations to a customer. The method selected change one or all of the six items recommended may well depend on how the e-commerce site wants the customer to use the recommendation. In the following we will examine 2.5 Moviefinder. com seven recommendation interfaces and how each assists the site Match Maker: Moviefinder coms Match in making money. While some of these methods have their roots (www.moviefinder.com)allowscustomerstolocatemovies in traditional commerce, each of them draws upon the strengths a similar"mood, theme, genre or cast" to a given movie. From of the electronic medium to provide more powerful the information page of the movie in question, customers click on recommendations the Match Maker icon and are provided with the list of Browsing: In traditional commerce a customer might walk into a recommended movies, as well as links to other films by the video store and ask the clerk to recommend "a comedy from the original films director and key actors 50s. Ideally, the clerk would recommend several movies, and We Predict: We Predict recommends movies to customers the customer could go off to locate the recommended movies based on their previously indicated interests. Customers enter a browse the box covers, and see which ones appealed to them. rating on a 5-point scale- from a to F- for movies they have However, the quality of the recommendations provided was viewed. These ratings are used in two different ways. Most dependent on the particular clerk's knowledge of an enormous simply, as they continue, the information page for non-rated range of movies. Reel. com has several advantages when movies contains a personalized textual prediction(go see it implementing browsing into their Movie Map feature. First, the forget it). In a variation of this, customers can use Powerfind to recommendations of several clerks/editors can be combined so search for top picks based on syntactic criteria such as Genre, that higher quality recommendations can be provided no matter directors, or actors and choose to have these sorted by their what the query parameters. Furthermore, recommendations are personalized prediction or by the all customer average returmed with immediate links to the items being recommended no more searching the store for the obscure videos recommended 2. 6 Reel. com Recommended browsing helps the E-commerce lovie Matches: Similar to Amazon. com's Custe BoughtReel.comsMovieMatches(www.reel.com)providesnarrowdowntheirchoicesandfeelmoreconfident recommendations on the information page for each movie. These decision to buy by providing organized access to the recommendations consist of"close matches"and/or "creative recommendations matches."Each set consists of up to a dozen hyperlinks to the Similar Item: Another modification of traditional commerce information pages for each of these"matched"films. The hyperlinks are annotated with one sentence descriptions of how techniques is the similar item recommendation. Systems such as the new movie is similar to the original movie in question Reel coms Movie Matcher. Amazon coms Customer's whe ("Darker thriller raises similarly disturbing questions. " ) Bought and one variation of CDNOW's Album Advisor attempt to expose customers to items they may have forgotten about, or of Movie Map: The Movie Map feature of Reel. com recommends which they may have simply been unaware to customers based on syntactic features. Customers implementation in E-commerce sites allows for more specific and queries based on Genre, movie types, viewing format personalized recommendations. The items displayed can be prices, and request results be constrained to"sleepers"or entirely selected based on the item(s)in which a customer has best of this genre. The recommendations s are editor's shown interest. In doing so, sites increase customer's exposure recommendations for movies that fit the specified criteria. to their product line, and ideally are able to sell more items per 2.7 Summary Email: Recommendations can also be delivered directly to recommendation hnology, and how users find customers through email, in a extension of traditional direct mail recommendations for all of the example applications. The first Amazon coms Eyes feature allows them to notit column just names each application, under the E-commerce site customers the minute an item becomes commercially available that houses it The second column describes the interface that Eyes enables Amazon. com to attract customers into their store used for delivering the recommendations. The third column before other stores with the same product can reach those
2.4 Levis Style Finder: Style Finder allows customers of the Levi Straus™ (www.levis.com) website to receive recommendations on articles of Levi’s clothing. Customers indicate whether they are male or female, then view three categories -- Music, Looks, Fun -- and rate a minimum of 4 “terms” or “sub-categories” within each. They do this by providing a rating on a 7-point scale ranging from “leave it” to “love it.” They may also choose the rating of “no opinion.” Once the minimum number of ratings are entered customers may select “get recommendations.” Here, they are provided with thumbnails of 6 items of recommended clothing. Customers may provide feedback by use of the “tell us what you think feature” which allows them to enter an opinion rating for the recommended article of clothing. Feedback may change one or all of the six items recommended. 2.5 Moviefinder.com Match Maker: Moviefinder.com’s Match Maker (www.moviefinder.com) allows customers to locate movies with a similar “mood, theme, genre or cast” to a given movie. From the information page of the movie in question, customers click on the Match Maker icon and are provided with the list of recommended movies, as well as links to other films by the original film’s director and key actors. We Predict: We Predict recommends movies to customers based on their previously indicated interests. Customers enter a rating on a 5-point scale -- from A to F – for movies they have viewed. These ratings are used in two different ways. Most simply, as they continue, the information page for non-rated movies contains a personalized textual prediction (go see it – forget it). In a variation of this, customers can use Powerfind to search for top picks based on syntactic criteria such as Genre, directors, or actors and choose to have these sorted by their personalized prediction or by the all customer average. 2.6 Reel.com Movie Matches: Similar to Amazon.com’s Customers who Bought, Reel.com’s Movie Matches (www.reel.com) provides recommendations on the information page for each movie. These recommendations consist of “close matches” and/or “creative matches.” Each set consists of up to a dozen hyperlinks to the information pages for each of these “matched” films. The hyperlinks are annotated with one sentence descriptions of how the new movie is similar to the original movie in question (“Darker thriller raises similarly disturbing questions… ”). Movie Map: The Movie Map feature of Reel.com recommends movies to customers based on syntactic features. Customers enter queries based on Genre, movie types, viewing format and/or prices, and request results be constrained to “sleepers” or “best of this genre.” The recommendations are editor’s recommendations for movies that fit the specified criteria. 2.7 Summary In Table 1 we have summarized the applications, interfaces, recommendation technology, and how users find recommendations for all of the example applications. The first column just names each application, under the E-commerce site that houses it. The second column describes the interface that is used for delivering the recommendations. The third column describes the recommendation technology used by the site, and the inputs required by that technology. The fourth column describes how users find recommendations using the application. Each of the columns of Table 1 is the subject of one of the sections of this paper, describing the meaning of the entries in the table, and their role in supporting recommender systems for E-commerce. 3. Recommendation Interfaces and Ways to Make Money An old proverb states that there is “more than one way to skin a cat.” One would assume that the method selected depends on the desired outcome. Similarly, there is more than one way to display recommendations to a customer. The method selected may well depend on how the e-commerce site wants the customer to use the recommendation. In the following we will examine seven recommendation interfaces, and how each assists the site in making money. While some of these methods have their roots in traditional commerce, each of them draws upon the strengths of the electronic medium to provide more powerful recommendations. Browsing: In traditional commerce a customer might walk into a video store and ask the clerk to recommend “a comedy from the 50s.” Ideally, the clerk would recommend several movies, and the customer could go off to locate the recommended movies, browse the box covers, and see which ones appealed to them. However, the quality of the recommendations provided was dependent on the particular clerk’s knowledge of an enormous range of movies. Reel.com has several advantages when implementing browsing into their Movie Map feature. First, the recommendations of several clerks/editors can be combined so that higher quality recommendations can be provided no matter what the query parameters. Furthermore, recommendations are returned with immediate links to the items being recommended – no more searching the store for the obscure videos recommended. Recommended browsing helps the E-commerce site by converting browsers into buyers. It does so by helping the users narrow down their choices and feel more confident in their decision to buy by providing organized access to the recommendations. Similar Item: Another modification of traditional commerce techniques is the similar item recommendation. Systems such as Reel.com’s Movie Matcher, Amazon.com’s Customer’s who Bought and one variation of CDNOW’s Album Advisor attempt to expose customers to items they may have forgotten about, or of which they may have simply been unaware. Their implementation in E-commerce sites allows for more specific and personalized recommendations. The items displayed can be entirely selected based on the item(s) in which a customer has shown interest. In doing so, sites increase customer’s exposure to their product line, and ideally are able to sell more items per order. Email: Recommendations can also be delivered directly to customers through email, in a extension of traditional direct mail techniques. Amazon.com’s Eyes feature allows them to notify customers the minute an item becomes commercially available. Eyes enables Amazon.com to attract customers into their store before other stores with the same product can reach those
hers. Furthermore, both Eyes and Amazon. com Delivers site in making money by increasing both loyalty, and the number the site to keep a customer aware of the site and of items of re the customer may have missed. Customers appreciate the email recommendations because they help them watch out for new items they are interested in purchasing. These features assist the Business/Applications Recommendation Recommendation Finding Customers who Bought Similar Item Item to Item Correlation Organic Navigation Purchase data ttribute based KEywords/freeform azon. com delivers Attribute Based Selection options Book matcher Top N List People to People Correlation Request List Customer Comments Average Rating Aggregated Rati OrganIc Navigation Text Comments CDNOW Album advise Similar ltem Item to Item Correlation Organic Navigation Top N List Purchase data Keywords/freeform My CDNoW Top N List People to People Correlation Organic Navigation Request list ay Average Rating Aggregated Rating Organic Navigation Text Comments Likert Text Levis tyle Finder Top N list People to People Correlation Request list Moviefinder. com Match Maker Similar item Item to Item Correlation Navigate to an item Editor's choice We predict Top n list people to People Correlatic Keywords/freeform Ordered Search Results Selection options Average Rat Likert anic na REels Movie matches Similar Item Item to Item Correlation Organic Navigation Editor's choice Movie Map Attribute based Editor 's choice customers with recommendations based directly on the text street" is the average rating feature. Rather than comments of other customers. Amazon coms Customer customers to browse a list of text based opinions Comments and eBays Feedback Profile streamlines the customers can provide numerical ranking opinions. B gathering of"the word on the street" by allowing customers to aggregating these rankings into an average rating, Customer locate an item of interest and browse the comments of other Comments and Feedback Profile both provide users with a"one customers. This helps sites make money by providing impartial stop"check on the quality of an item. Similar to text comments, information on the goods/services being sold - the thought being average ratings should facilitate in converting browsers into if enough people claim that a book is good or a seller is credible buyers, and increasing customer loyalty to the an it is likely to be true. This not only helps convert browsers Top-N: Amazon. com's Book Matcher, Levi's Style Finder and into buyers, but should oyalty to a site. If customers My CdNOW, among others, take advantage of recommendations learn they can trust these third party recommendations, than they through a top-N list. Once each site has learned details about a are more likely to return the next time they are faced with a questionable decision. customer's likes and dislikes, each is able to provide the
customers.. Furthermore, both Eyes and Amazon.com Delivers allows the site to keep a customer aware of the site and of items the customer may have missed. Customers appreciate the email recommendations because they help them watch out for new items they are interested in purchasing. These features assist the site in making money by increasing both loyalty, and the number of return visits. Business/Applications Recommendation Interface Recommendation Technology Finding Recommendations Amazon.com Customers who Bought Similar Item Item to Item Correlation Purchase data Organic Navigation Eyes Email Attribute Based Keywords/freeform Amazon.com Delivers Email Attribute Based Selection options Book Matcher Top N List People to People Correlation Likert Request List Customer Comments Average Rating Text Comments Aggregated Rating Likert Text Organic Navigation CDNOW Album Advisor Similar Item Top N List Item to Item Correlation Purchase data Organic Navigation Keywords/freeform My CDNOW Top N List People to People Correlation Likert Organic Navigation Request List eBay Feedback Profile Average Rating Text Comments Aggregated Rating Likert Text Organic Navigation Levis Style Finder Top N List People to People Correlation Likert Request List Moviefinder.com Match Maker Similar Item Item to Item Correlation Editor’s choice Navigate to an item We Predict Top N List Ordered Search Results Average Rating People to People Correlation Aggregated Rating Likert Keywords/freeform Selection options Organic Navigation Reel.com Movie Matches Similar Item Item to Item Correlation Editor’s choice Organic Navigation Movie Map Browsing Attribute Based Editor’s choice Keywords/freeform Table 1: Recommender System Examples Text Comments: More and more frequently, sites are providing customers with recommendations based directly on the text comments of other customers. Amazon.com’s Customer Comments and eBay’s Feedback Profile streamlines the gathering of “the word on the street” by allowing customers to locate an item of interest and browse the comments of other customers. This helps sites make money by providing impartial information on the goods/services being sold – the thought being, if enough people claim that a book is good, or a seller is credible, than it is likely to be true. This not only helps convert browsers into buyers, but should increase loyalty to a site. If customers learn they can trust these third party recommendations, than they are more likely to return the next time they are faced with a questionable decision.. Average Rating: Even simpler access to “the word on the street” is the average rating feature. Rather than asking customers to browse a list of text based opinions, other customers can provide numerical ranking opinions. By aggregating these rankings into an average rating, Customer Comments and Feedback Profile both provide users with a “one stop” check on the quality of an item. Similar to text comments, average ratings should facilitate in converting browsers into buyers, and increasing customer loyalty to the site. Top-N: Amazon.com’s Book Matcher, Levi’s Style Finder and My CDNOW, among others, take advantage of recommendations through a top-N list. Once each site has learned details about a customer’s likes and dislikes, each is able to provide the
customer with recommendation is generated without explicit effort by items for that customer. It is as though one could gather all of the customer. The customer just interacts with the site as he or clothes that might interest a given client onto a single rack wishes, and suddenly a recommendation appears that without distracting them with items they will not be interested appropriate for the customer's interests. Manual means that the in. This helps the vendor in several ways. First, it is another customer takes explicit effort to seek out recommendations that conv ing browsers into buyers it provides will fit her interests. Note that recommendations that increased exposure to the vendors wares, but only to those items Manual from the perspective of the user may be generated by the that should truly interest the user. Second, it may help the site using a computer program. We consider these Manual, since customer in making a decision about items that they originally we are taking the customers perspective. Likewise held in doubt -the suggestion from the site may be another point recommendations that appear automatically for the customer, bu in favor of the item that are generated by hand by the site are considered Automatic Ordered Search Results: Finally, a less restrictive variation of Whether the site uses a computer or a human to implement its the top-N list are Ordered Search Results recommendations recommendation algorithms is unimportant to the customer. While top-N limits the predictions to some predefined number, The persistence axis ranges from completely Ephemeral ordered search results allow the customer to continue to look at recommendations to Persistent recommendations. Ephemeral We Predict feature allows customers to have query returns sorted recommendations are made based entirely on a single customer ession, and are not based on any information from previous by the predicted likelihood that the customer will enjoy the item. sessions of this customer. Persistent recommendations are based Once again, this helps convert browsers into buyers on the site recognizing the customer, and suggesting products to the customer based on the customer's likes and dislikes in persistent previous sessions. This section is structured at the high level around the four recommendation techniques: non-personalized, attribute based Style Finder item-to-item correlations, and people-to-people correlations. For each technique, we briefly introduce it, explain its place in the taxonomy, and give examples of it from our recommender system 4.1 Non-Personalized recommendations Manua Non-personalized recommender systems recommend products to customers based on what other customers have said about the products on average. The recommendations are independent of the customer, so each customer gets the same recommendations Non-personalized recommender systems are Automatic, because ittle customer effort t not recognize the customer from one session to the next since the recommendations are not based on the customer. Non- Ephemer ovie Finder. Amazon personalized recommender systems are common in physical Figure 1: Recommendation Taxonomy without change by every customer on a display that is viewed stores, since they can be set up 4. A Taxonomy for Mapping Applications to For instance, the average customer ratings displayed by Amazon.comandMoviefinder.comarenon-personalized Recommendation Techniques recommendations. These recommendations are completely In this section we describe the Recommendation Technology independent of the particular customer targeted by the column of Table I in detail. We first lay out the differer recommender system. eBay has a slightly different form of non recommender system applications in a taxonomy of personalized recommendation in its feedback profile. Customers recommendation types. We then describe the different user give feedback on each other, rather than on products! The inputs, which are the italicized entries in the table. The goal of average and individual feedback is then available for the taxonomy is to present a completely user-focused analysis of consideration by buyers to decide whether a particular seller is a the different recommender systems, so the taxonomy is based on good risk, and by sellers to decide whether a particular buyer is a the features most important to customers of the E-commerce good risk. All three of these systems are nearly completely on sites. The two key dimensions in the taxonomy are the degree of the Automatic and Ephemeral end of the axes. Another type of automation, and the degree of persistence in the non-personalized recommendation is the text comments recommendations( Figure 1) supported in Amazons Customer Comments and eBays The automation axis ranges from completely Automatic Feedback Profile. Both of these are still Ephemeral, but move recommendations to completely Manual recommendations From closer to the Manual end of the other axis. In a sense, the system the perspective of the customer, Automatic means that the is merely providing raw data to the user, who must then collate
customer with a personalized list of the top number of unrated items for that customer. It is as though one could gather all of the clothes that might interest a given client onto a single rack without distracting them with items they will not be interested in. This helps the vendor in several ways. First, it is another example of converting browsers into buyers – it provides increased exposure to the vendor’s wares, but only to those items that should truly interest the user. Second, it may help the customer in making a decision about items that they originally held in doubt – the suggestion from the site may be another point in favor of the item. Ordered Search Results: Finally, a less restrictive variation of the top-N list are Ordered Search Results recommendations. While top-N limits the predictions to some predefined number, ordered search results allow the customer to continue to look at items highly likely to be of interest to them. Moviefinder.com’s We Predict feature allows customers to have query returns sorted by the predicted likelihood that the customer will enjoy the item. Once again, this helps convert browsers into buyers. Amazom.com Delivers My CDNOW eBay Movie Map Album Advisor Match Maker Movie Match Customers who Bought Book Match We Predict Style Finder Average Movie Finder, Amazon Persistent Ephemeral Manual Auto Figure 1: Recommendation Taxonomy 4. A Taxonomy for Mapping Applications to Recommendation Techniques In this section we describe the Recommendation Technology column of Table 1 in detail. We first lay out the different recommender system applications in a taxonomy of recommendation types. We then describe the different user inputs, which are the italicized entries in the table. The goal of the taxonomy is to present a completely user-focused analysis of the different recommender systems, so the taxonomy is based on the features most important to customers of the E-commerce sites. The two key dimensions in the taxonomy are the degree of automation, and the degree of persistence in the recommendations (Figure 1). The automation axis ranges from completely Automatic recommendations to completely Manual recommendations. From the perspective of the customer, Automatic means that the recommendation is generated without explicit effort by the customer. The customer just interacts with the site as he or she wishes, and suddenly a recommendation appears that is appropriate for the customer’s interests. Manual means that the customer takes explicit effort to seek out recommendations that will fit her interests. Note that recommendations that are Manual from the perspective of the user may be generated by the site using a computer program. We consider these Manual, since we are taking the customer’s perspective. Likewise, recommendations that appear automatically for the customer, but that are generated by hand by the site are considered Automatic. Whether the site uses a computer or a human to implement its recommendation algorithms is unimportant to the customer. The persistence axis ranges from completely Ephemeral recommendations to Persistent recommendations. Ephemeral recommendations are made based entirely on a single customer session, and are not based on any information from previous sessions of this customer. Persistent recommendations are based on the site recognizing the customer, and suggesting products to the customer based on the customer’s likes and dislikes in previous sessions. This section is structured at the high level around the four recommendation techniques: non-personalized, attribute based, item-to-item correlations, and people-to-people correlations. For each technique, we briefly introduce it, explain its place in the taxonomy, and give examples of it from our recommender system examples. 4.1 Non-Personalized Recommendations Non-personalized recommender systems recommend products to customers based on what other customers have said about the products on average. The recommendations are independent of the customer, so each customer gets the same recommendations. Non-personalized recommender systems are Automatic, because they require little customer effort to generate the recommendation, and are Ephemeral, because the system does not recognize the customer from one session to the next since the recommendations are not based on the customer. Nonpersonalized recommender systems are common in physical stores, since they can be set up on a display that is viewed without change by every customer. For instance, the average customer ratings displayed by Amazon.com and Moviefinder.com are non-personalized recommendations. These recommendations are completely independent of the particular customer targeted by the recommender system. eBay has a slightly different form of nonpersonalized recommendation in its feedback profile. Customers give feedback on each other, rather than on products! The average and individual feedback is then available for consideration by buyers to decide whether a particular seller is a good risk, and by sellers to decide whether a particular buyer is a good risk. All three of these systems are nearly completely on the Automatic and Ephemeral end of the axes. Another type of non-personalized recommendation is the text comments supported in Amazon’s Customer Comments and eBay’s Feedback Profile. Both of these are still Ephemeral, but move closer to the Manual end of the other axis. In a sense, the system is merely providing raw data to the user, who must then collate the data and make sense out of it manually