Parallel Collaborative Filtering for the Netflix Prize (results & discussion) AISC Foundational

Published on ● Video Link: https://www.youtube.com/watch?v=6fB0McQFSHQ



Category:
Discussion
Duration: 16:47
239 views
1


Toronto Deep Learning Series, 17-Jan-2019
https://tdls.a-i.science/events/2019-01-17

Paper: https://endymecy.gitbooks.io/spark-ml-source-analysis/content/%E6%8E%A8%E8%8D%90/papers/Large-scale%20Parallel%20Collaborative%20Filtering%20the%20Netflix%20Prize.pdf

Discussion Panel: Preston Engstrom, Serena McDonnell, Omar Nada

Host: IEEE student chapter at Ryerson University

LARGE-SCALE PARALLEL COLLABORATIVE FILTERING FOR THE NETFLIX PRIZE

Many recommendation systems suggest items to users by
utilizing the techniques of collaborative filtering (CF) based on historical records of items that the users have viewed, purchased, or rated. Two major problems that most CF approaches have to resolve are scalability and sparseness of the user profiles. In this paper, we describe Alternating-Least-Squares with Weighted-λ-Regularization (ALS-WR), a parallel algorithm that we designed for the Netflix Prize, a large-scale collaborative filtering challenge. We use parallel Matlab on a Linux cluster as the experimental platform. We show empirically that the performance of ALS-WR monotonically increases with both the number of features and the number of ALS iterations. Our ALS-WR applied to the Netflix dataset with 1000 hidden features obtained a RMSE score of 0.8985, which is one of the best results based on a pure method. Combined with the parallel version of other known methods, we achieved a performance improvement of 5.91% over Netflix’s own CineMatch recommendation system. Our method is simple and scales well to very large datasets.




Other Videos By LLMs Explained - Aggregate Intellect - AI.SCIENCE


2019-02-12Tensor Field Networks | AISC
2019-02-08ACAI: Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer
2019-02-05Code Review: Transformer - Attention Is All You Need | AISC
2019-02-04[StyleGAN] A Style-Based Generator Architecture for GANs, part2 (results and discussion) | TDLS
2019-02-04[StyleGAN] A Style-Based Generator Architecture for GANs, part 1 (algorithm review) | TDLS
2019-02-04TDLS: Learning Functional Causal Models with GANs - part 1 (algorithm review)
2019-02-04TDLS: Learning Functional Causal Models with GANs - part 2 (results and discussion)
2019-02-04Neural Ordinary Differential Equations - part 1 (algorithm review) | AISC
2019-02-04Neural Ordinary Differential Equations - part 2 (results & discussion) | AISC
2019-02-04Parallel Collaborative Filtering for the Netflix Prize (algorithm review) | AISC Foundational
2019-02-04Parallel Collaborative Filtering for the Netflix Prize (results & discussion) AISC Foundational
2019-01-15TDLS - Announcing Fast Track Stream
2019-01-09Extracting Biologically Relevant Latent Space from Cancer Transcriptomes \w VAEs(discussions) I AISC
2019-01-09Extracting Biologically Relevant Latent Space from Cancer Transcriptomes \w VAEs (algorithm) | AISC
2019-01-09[original backprop paper] Learning representations by back-propagating errors (part1) | AISC
2019-01-09[original backprop paper] Learning representations by back-propagating errors (part2) | AISC
2018-12-17Automated Deep Learning: Joint Neural Architecture and Hyperparameter Search (discussions) | AISC
2018-12-17Automated Deep Learning: Joint Neural Architecture and Hyperparameter Search (algorithm) | AISC
2018-12-10Automated Vulnerability Detection in Source Code Using Deep Learning (discussions) | AISC
2018-12-10Automated Vulnerability Detection in Source Code Using Deep Learning (algorithm) | AISC
2018-12-06[DQN] Human-level control through deep reinforcement learning (discussions) | AISC Foundational



Tags:
collaborative filtering
netflix
recommender engine
recommendation system
machine learning