Tag Archives: analytics

My thoughts on AI, Big Data, and IS Research

Last update: June 10th, 2021

Recently, I had a chance to share my thoughts on how Big Data Analytics and AI will impact Information Systems (IS) research. Thanks to ever-growing datasets (public and proprietary) and powerful computational resources (cloud API, open-source projects), AI and Big Data will be important in IS research in the foreseeable future. If you are an aspiring IS researcher, I believe that you should be able to embrace this and take advantage of this.

First, AI and Big Data are powerful “tools” for IS research. It could be intimidating to see all the fancy new AI techniques. But they are just tools to analyze your data. You don’t need to reinvent the wheel to use them. There are many open-source projects in Python and R that you can use to analyze your data. Also, many cloud services (e.g., Amazon Rekognition, Google Cloud ML, Microsoft Azure ML) allow you to use pre-trained AI models at a modest cost (that your professors can afford). What you need is some working knowledge in programming languages like Python and R. And a high-level understanding of the idea behind algorithms.

Don’t shy away from hands-on programming. Using AI and Big Data tools may not be a competitive advantage in the long run because of the democratization of AI tools. However, I believe it will be the new baseline. So you need to have it in your research toolbox. Specifically, I believe that IS researchers should have a working knowledge of Python/R programming and Linux environment. I recommend these online courses: Data ScienceMachine LearningLinuxSQL, and NoSQL.

Second, AI and Big Data Analytics are creating a lot of interesting new “phenomenon” in personal lives, firms, and societies. How AI and robots will be adopted in the workplace and how that will affect the labor market? Are we losing our jobs? Or can we improve our productivity with AI tools? How AI will be used in professional services by the experts? What are the unintended consequences (such as biases, security, privacy, misinformation) of AI adoptions in the organization and society? And how can we mitigate such issues? There are so many new and interesting research questions.

In order to conduct relevant research, I think that IS researchers should closely follow the emerging technologies. Again, it could be hard to keep up with all the advances. I try to keep up to date by reading industry reports (from McKinsey and Deloitte) and listening to many podcasts (e.g., Freakonomics Radio, a16 Podcasts by Andreessen Horowitz, Lex Fridman Podcast, Stanford’s Entrepreneurial Thought Leaders, HBR’s Exponential View by Azeem Azhar).

I hope this post may help new IS researchers shape their research strategies. I will try to keep updating this post. Cheers!

 

 

IS / Marketing Papers on Visual Data Analytics (Image, Video)

Last update: July 19, 2021

With the advent of social media and mobile platforms, visual data are becoming the first citizen in big data analytics research. Compared to textual data that require significant cognitive efforts to comprehend, visual data (such as image and video) can easily convey the message from the content creator to the general audience. To conduct large-scale studies on such data types, researchers need to use machine learning and computer vision approaches. In this post, I am trying to organize studies in Information Systems, Marketing, and other management disciplines that leverage large-scale analysis of image and video datasets. The papers are ordered randomly:

  1. Zhou, M., Chen, G. H., Ferreira, P., Smith, M. D. (2021) “Consumer Behavior in the Online Classroom: Using Video Analytics and Machine Learning to Understand the Consumption of Video Courseware,” Journal of Marketing Research, forthcoming.
  2. Shin, D., He, S., Lee, G. M., Whinston, A. B., Cetintas, S., Lee, K.-C. (2020) “Enhancing Social Media Analysis with Visual Data Analytics: A Deep Learning Approach,” MIS Quarterly 44(4): 1459-1492[Details]
  3. Li, Y., Xie, Y. (2020) “Is a Picture Worth a Thousand Words? An Empirical Study of Image Content and Social Media Engagement,” Journal of Marketing Research 57(2): 1-19.
  4. Zhang, Q., Wang, W., Chen, Y. (2020) “Frontiers: In-Consumption Social Listening with Moment-to-Moment Unstructured Data: The Case of Movie Appreciation and Live comments,” Marketing Science 39(2).
  5. Liu, L., Dzyabura, D., Mizik, N. (2020) “Visual Listening In: Extracting Brand Image Portrayed on Social Media,Marketing Science 39(4): 669-686.
  6. Peng, L., Cui, G., Chung, Y., Zheng, W. (2020) “The Faces of Success: Beauty and Ugliness Premiums in E-Commerce Platforms,” Journal of Marketing 84(4): 67-85.
  7. Liu, X., Zhang, B., Susarla, A., Padman, R. (2020) “Go to YouTube and Call Me in the Morning: Use of Social Media for Chronic Conditions,” MIS Quarterly 44(1b): 257-283.
  8. Park, S., Lee, G. M., Shin, D., Han, S.-P. (2020) “Targeting Pre-Roll Ads using Video Analytics,” Working Paper.
  9. Zhao, K., Hu, Y., Hong, Y., Westland, J. C. (2020) “Understanding Characteristics of Popular Streamers in Live Streaming Platforms: Evidence from Twitch.tv,” Journal of the Association for Information Systems, Forthcoming.
  10. Ordenes, F. V., Zhang, S. (2019) “From words to pixels: Text and image mining methods for service research,” Journal of Service Management 30(5): 593-620.
  11. Wang, Q., Li, B., Singh, P. V. (2018) “Copycats vs. Original Mobile Apps: A Machine Learning Copycat-Detection Method and Empirical Analysis,” Information Systems Research 29(2): 273-291.
  12. Lu, S., Xiao, L., Ding, M. (2016) “A Video-Based Automated Recommender (VAR) System for Garments,” Marketing Science 35(3): 484-510.
  13. Xiao, L., Ding, M. (2014) “Just the Faces: Exploring the Effects of Facial Features in Print Advertising,” Marketing Science 33(3), 315-461.
  14. Zhang, S., Lee, D., Singh, P. V., Srinivasan, K. (2018) “How Much is an Image Worth? Airbnb Property Demand Estimation Leveraging Large Scale Image Analytics,” CMU Working Paper.
  15. Choi, A., Ramaprasad, J., So, H. (2021) Does Authenticity of Influencers Matter? Examining the Impact on Purchase Decisions, Working Paper.
  16. Park, J., Kim, J., Cho, D., Lee, B. Pitching in Character: The Role of Video Pitch’s Personality Style in Online Crowdsourcing, Working Paper.
  17. Yang, J., Zhang, J., Zhang Y. (2021) First Law of Motion: Influencer Video Advertising on TikTok, Working Paper.
  18. Davila, A., Guasch (2021) Manager’s Body Expansiveness, Investor Perceptions, and Firm Forecast Errors and Valuation, Working Paper.
  19. Peng, L., Teoh, S. H., Wang, U., Yan, J. (2021) Face Value: Trait Inference, Performance Characteristics, and Market Outcomes for Financial Analysts, Working Paper.
  20. Zhang, S., Friedman, E., Zhang, X., Srinivasan, K., Dhar, R. (2020) Serving with a Smile on Airbnb: Analyzing the Economic Returns and Behavioral Underpinnings of the Host’s Smile,” Working Paper.
  21. Park, K., Lee, S., Tan, Y. (2020) “What Makes Online Review Videos Helpful? Evidence from Product Review Videos on YouTube,” UW Working Paper.
  22. Doosti, S., Lee, S., Tan, Y. (2020) “Social Media Sponsorship: Metrics for Finding the Right Content Creator-Sponsor Matches,” UW Working Paper.
  23. Koh, B., Cui, F. (2020) “Give a Gist: The Impact of Thumbnails on the View-Through of Videos,” KU Working Paper.
  24. Gunarathne, P., Rui, H., Seidman, A. (2019) “Racial Discrimination in Social Media Customer Service: Evidence from a Popular Microblogging Platform,” Rochester Working Paper.
  25. Hou J.R., Zhang J., Zhang K. (2018) Can title images predict the emotions and the performance of crowdfunding projects? Workshop on e-Business.

Trustworthy Face? The Effect and Drivers of Comprehensive Trust in Online Job Market Platform

Kwon, Jun Bum, Donghyuk Shin, Gene Moo Lee, Jake An, Sam Hwang (2020) “Trustworthy Face? The Effect and Drivers of Comprehensive Trust in Online Job Market Platform”. Work-in-progress.

The abstract will appear here.

Robots Serve Humans: Does AI Robot Adoption Enhance Operational Efficiency and Customer Experience?

Lee, Myunghwan, Gene Moo Lee, Donghyuk Shin, Sang-Pil Han (2020) “Robots Serve Humans: Does AI Robot Adoption Enhance Operational Efficiency and Customer Experience?Working Paper.

  • Presented at WITS (2020), KrAIS (2020), UBC (2021)
  • Research assistants: Raymond Situ, Gallant Tang

Service providers have been adopting various robotics technologies to improve operational efficiency and increase customer satisfaction. Robotics technologies bring new restaurant experiences to customers by taking orders, cooking, and serving. While the impact of industrial robots has been well documented in the literature, little is known about the impact of customer-facing service robot adoption. To fill this gap, this work-in-progress study aims to analyze the impact of service robot adoption on restaurant service quality using 4,612 restaurants and their online customer reviews. We analyzed the treated effect of robot adoption using a difference-in-differences approach with propensity score and exact matching. Estimation results show that restaurant robot adoption has a positive impact on customer satisfaction, specifically on perceived food quality and perceived value. This study provides both academic and practical implications on the emerging AI robotics techniques.

A Scaling Perspective in AI Startups

Schulte-Althoff, Matthias, Daniel Fuerstenau, Gene Moo Lee, Hannes Rothe, Robert Kauffman (2021) “A Scaling Perspective in AI Startups”. Working Paper. [ResearchGate]

  • Presented at HICSS 2021 (SITES mini-track)

Digital startups’ use of AI technologies has significantly increased in recent years, bringing to the fore specific barriers to deployment, use, and extraction of business value from AI. Utilizing a quantitative framework regarding the themes of startup growth and scaling, we examine the scaling behavior of AI, platform, and service startups. We find evidence of a sublinear scaling ratio of revenue to age-discounted employment count. The results suggest that the revenue-employee growth pattern of AI startups is close to that of service startups, and less so to that of platform startups. Furthermore, we find a superlinear growth pattern of acquired funding in relation to the employment size that is largest for AI startups, possibly suggesting hype tendencies around AI startups. We discuss implications in the light of new economies of scale and the scope of AI startups related to decision-making and prediction.

Observations and Strategies of Online Teaching

Last update: April 21, 2021

All of a sudden, instructors are in the situation to teach online. I am taking this opportunity to develop a hybrid model for effective teaching. In this post, I will summarize my observations, experiences, and possible solutions. A caveat is that I teach “technical” courses in business analytics, so some of the issues I discussed here may not be directly applicable to “qualitative” courses. Also, note that this post is a work-in-progress and may be updated in the future.

  1. Reading the class
    1. One challenge in online lectures is that it is hard to “read the class”.
    2. We can ask students to turn on their videos so that instructors can see their facial expressions and catch non-verbal cues.
    3. We can use the chat/poll features to get instant, short feedbacks (even shy students feel comfortable sharing their thoughts in this textual mode).
    4. Now that all class activities are online, instructors have access to detailed analytics data that can be used to read the class throughout the course (not necessarily an individual class meeting).
  2. Effectively delivering materials
    1. In an online situation, the attention span is really short. Thus we need to chunk lectures into 20-30 min pieces with 10-15 min lecture + 10-15 min individual/group exercise.
    2. The breakout group feature works really well. Students can clarify issues with each other during the breakout group time. TAs can help in this process as well.
    3. Sometimes, students may ask some “out-of-scope” questions. In online sessions, we can let TAs find the relevant information and post it in an online Q&A forum (I use Piazza).
    4. Just like in offline teaching, TAs and instructors can hold virtual office hours. Sharing screen works really well.
  3. Building high-touch community
    1. One of the downsides of having online classes is that students don’t have opportunities to build a personal connection with the professor and with each other.
    2. We can create “introduction videos” to build relationships.
    3. For ice-breaking purposes, when starting the online lecture session, instructors can enter the session 5-10 min before the lecture starts (just like we do in offline lectures).
    4. Online forums (e.g., Piazza) can facilitate peer interactions.
    5. Finally, online environments allow us to invite virtually any guest speakers from all around the world. We can easily invite high-profile speakers and alumni to online class sessions. Universities can create a lot of value by leveraging the alumni network.
  4. Course participation
    1. One challenge I faced was the objective measure of the course participation events. I recorded all the chat history and asked TAs to count how many times each student verbally asked questions or made comments. As I used Piazza as the Q&A forum, I also incorporated the question/comment/endorsement counts from its analytics data.
    2. Some students questioned if we can use in-class chats or virtual office hour visits are counted. Whichever option an instructor chose, it has to be clearly stated in the course outline to avoid any confusion.
  5. Exam
    1. I used an open book/note exam given the nature of the subject.
    2. To avoid the possibility of collusion, I created multiple question banks for each subject and difficulty level. In Canvas, the exam is dynamically generated by picking random questions from the question banks. To implement this, I had to create 3x exam questions than a paper-based exam. In Canvas, the order of multiple choice answers can be randomized as well.
    3. One challenge is to inform students of any clarification issues in the exam. In case one student found an issue with the exam, it is hard to share this information with the whole class. So I decided not to handle any content issues during the exam time.

Corporate Social Network Analysis: A Deep Learning Approach

Cao, Rui, Gene Moo Lee, Hasan Cavusoglu (2020) “Corporate Social Network Analysis: A Deep Learning Approach,” Working Paper.

Identifying inter-firm relationships is critical in understanding the industry landscape. However, due to the dynamic nature of such relationships, it is challenging to capture corporate social networks in a scalable and timely manner. To address this issue, this research develops a framework to build corporate social network representations by applying natural language processing (NLP) techniques on a corpus of 10-K filings, describing the reporting firms’ perceived relationships with other firms. Our framework uses named-entity recognition (NER) to locate the corporate names in the text, topic modeling to identify types of relationships included, and BERT to predict the type of relationship described in each sentence. To show the value of the network measures created by the proposed framework, we conduct two empirical analyses to see their impacts on firm performance. The first study shows that competition relationship and in-degree measurements on all relationship types have prediction power in estimating future earnings. The second study focuses on the difference between individual perspectives in an inter-firm social network. Such a difference is measured by the direction of mentions and is an indicator of a firm’s success in network governance. Receiving more mentions from other firms is a positive signal to network governance and it shows a significant positive correlation with firm performance next year.

IS Papers on Big Data, Analytics, and AI

Last update: Sept 30, 2021

My research involves Big Data Analytics and AI in Information Systems literature. This post tries to keep track of the editorial and seminal articles on the topic of Big Data, Data Science, Analytics, and AI in the Information Systems and Management literature. The papers are listed in chronological order:

  1. Bapna, Goes, Gopal, Marsden (2006) Moving from Data-Constrained to Data-Enabled Research: Experiences and Challenges in Collecting, Validating and Analyzing Large-Scale e-Commerce Data, Statistical Science 21(2): 116-130.
  2. Shmueli and Koppius (2011) Predictive Analytics in Information Systems Research, MIS Quarterly 35(3): 553-572
  3. Chen, Chiang, Storey, (2012) Business Intelligence and Analytics: From Big Data to Big Impact, MIS Quarterly 36(4): 1164-1188
  4. Lin, Lucas Jr., Shmueli (2013) Research Commentary: Too Big to Fail: Large Samples and the p-Value Problem, Information Systems Research 24(4): 906-917.
  5. Agarwal, Dhar (2014) Editorial – Big Data, Data Science, and Analytics: The Opportunity and Challenge for IS Research, Information Systems Research 25(3): 443-448
  6. Varian (2014) Big Data: New Tricks for Econometrics, Journal of Economic Perspectives 28(2): 3-28
  7. Goes (2014) Editor’s Comments: Big Data and IS Research, MIS Quarterly 38(3): iii-viii
  8. Saar-Tsechansky (2015) Editors’ Comments: The Business of Business Data Science in IS Journals, MIS Quarterly 39(4): iii-vi
  9. AMJ Editors (2016) From the Editors: Big Data and Data Science Methods for Management Research, Academy of Management Journal 59(5): 1493-1507
  10. Abbasi, Sarker, Chiang (2016) Big Data Research in Information Systems: Toward an Inclusive Research Agenda, Journal of the Association for Information Systems 17(2): i-xxxii
  11. Rai (2016) Editor’s Comments: Synergies Between Big Data and Theory, MIS Quarterly 40(2): iii-ix
  12. Baesens, Bapna, Marsden, Vanthienen, Zhao (2016) Transformational Issues of Big Data and Analytics in Networked Business, MIS Quarterly 40(4): 807-818
  13. Athey (2017) Beyond Prediction: Using Big Data for Policy Problems, Science 355(6324): 483-485
  14. Chiang, Grover, Liang, Zhang (2018) Special Issue: Strategic Value of Big Data and Business Analytics, Journal of Management Information Systems 35(2): 383-387
  15. Delen, Ram (2018) Research challenges and opportunities in business analytics, Journal of Business Analytics 1(1): 2-12.
  16. Maass, Parsons, Puraro, Storey, Woo (2018) Data-Driven Meets Theory-Driven Research in the Era of Big Data: Opportunities and Challenges for Information Systems Research, Journal of the Association for Information Systems 19(12): 1253-1273
  17. Yang, Adomavicius, Burtch, Ren (2018) Mind the Gap: Accounting for Measurement Error and Misclassification in Variables Generated via Data Mining, Information Systems Research 29(1): 4-24.
  18. Berente, Seidel, Safadi (2019) Research Commentary: Data-Driven Computationally Intensive Theory Development, Information Systems Research 30(1), 50-64.
  19. Johnson, Gray, Sarker (2019) Revisiting IS Research Practice in the Era of Big Data, Information and Organization 29(1): 41-56
  20. Grover, Lindberg, Benbasat, Lyytinen (2020) The Perils and Promises of Big Data Research in Information Systems, Journal of the Association for Information Systems 21(2): 268-291.
  21. Shmueli (2021) INFORMS Journal of Data Science (IJDS) Editorial #1: What is an IJDS paper?, INFORMS Journal of Data Science.
  22. Burton-Jones, Boh, Oborn, Padmanabhan (2021) Editor’s Comments: Advancing Research Transparency at MIS Quarterly: A Pluralistic Approach, MIS Quarterly 45(2): iii-xviii.
  23. Berente, Gu, Recker, Santhanam (2021) Special Issue Editor’s Comments: Managing Artificial Intelligence, MIS Quarterly 45(3): 1433-1450.
  24. Jain, Padmanabhan, Pavlou, Raghu (2021) Editorial for the Special Section on Humans, Algorithms, and Augmented Intelligence: The Future of Work, Organizations, and Society, Information Systems Research 32(3): 675-687.