Professional Documents
Culture Documents
978-981-15-7984-4_2
978-981-15-7984-4_2
Recommendation Model
1 Introduction
recommendation process will be affected by many factors. For example, the user-POIs
check-in matrix is highly sparse, which is the main reason why it is difficult to capture
the user’s preference, the user’s interest changes with time and location, and the text
description of POI is incomplete and fuzzy. It has become a hot topic in the field of POI
research to study these factors to improve the quality of POI recommendation. The
current difficulties of POI recommendation are still data sparseness and cold start of
users, which leads to impossible to accurately capture the user’s preference only from a
small percentage of the points of interest that we get from users [2]. In order to solve
the problem of data sparseness, this paper combines the user-POIs rating matrix and the
user-POIs check-in matrix, and forecasts the user’s unrated POIs score using matrix
factorization, which can reduce the data sparseness and facilitate the capture of user
preferences. Then, the prediction matrix is combined with the user-POIs check-in
matrix, which can enhance the degree of the user’s favorite POIs. In this work, we also
study the similarity of POIs and the geographic influence of POIs. Finally, we model
four types of information in a unified POI recommendation framework and compared
them experimentally. Experimental results on two real world datasets show that higher
recommendation performance can be achieved by considering both user check-in
behavior and user rating behavior.
The contributions of this paper are as follows:
1. User check-in behavior and user rating behavior are considered at the same time,
which effectively reduces data sparseness and helps us obtain user preferences;
2. We integrate four types of information: user check-in information, user rating
information, geographic influence of POIs and similarity of POIs into a unified
model framework for POI recommendation on LBSNs;
3. Several experiments are conducted on two real world datasets, and the results show
that our method improves the accuracy of POI recommendations compared to other
recent methods.
2 Related Work
more compact and the distribution of different types of samples more loose. When
calculating the similarity between users/items in the recommendation algorithm,
Euclidean distance and Cosine similarity are usually used for calculation. In fact, there
are many other measures besides Euclidean distance and cosine similarity, such as
Manhattan distance, Chebyshev distance and Mahalanobis distance. Cosine similarity
and Euclidean distance are commonly used in some current recommendation algo-
rithms to calculate the similarity between users and items, For example, He et al. [20]
proposed a translation-based recommendation mode (TransRec), to predict and build
the third-order interaction between users, items he previously visited and the next item
in large scale. Wang et al. [21] proposed a video recommendation algorithm based on
clustering and hierarchical model. The algorithm obtains similar users through clus-
tering, and then collects the historical data of similar users’ online video to form a
video recommendation set, improving the performance and user experience of the
recommendation system. Zhang et al. [22] used Euclidean distance instead of matrix
factorization to measure the similarity between users. Two metric decomposition
variables were designed in this paper, one for rating evaluation and another for per-
sonalized item ranking.
3 UPEMF Algorithm
First of all, the Gowalla and Foursquare datasets are processed using time division and
multi-granularity space division to filter POIs with low visits and users who have fewer
check-ins; Next, we transform the sparse rating matrix into a prediction matrix through
probability matrix factorization; Again, we use the Hadamard product of the prediction
matrix and the check-in matrix to form a weight matrix, and use the weight matrix to
find the similarity of the POIs; At length, combining the similarity of POIs and the
physical distance of POIs, the top k minimum values are obtained and recommended
to users.
Table 1. (continued)
Symbol Meaning
x, y User-POIs check-in to a vector of two different POIs in a matrix
P
Covariance matrix
r2R , r2U , r2V Hyperparameter
dij Physical distance between POI i and POI j
w Weight value
Figure 2 is a heat map formed by the Gowalla data set. The red areas represent
areas that are popular with users, and the blue areas represent areas that users may not
be interested in.
effectively handle large-scale data as well as sparse data and the probability matrix
factorization algorithm does not spend a lot of time on the query, we use the probability
matrix factorization algorithm for rate prediction. Suppose U 2 Rmk and V 2 Rnk are
potential matrices of users and POIs respectively. We can calculate the predicted rate
value through two potential matrices. The conditional probability distribution function
of the rate matrix R is as follows:
m Y
Y
R
n Ii;j
pðRjU; V; r2R Þ ¼ ½NðRij jgðUi Vj Þ; rR Þ
T 2
ð1Þ
i¼1 j¼1
Nðxjl; r2 Þ is a Gaussian probability density function with l as the mean and r2 as the
variance, gðxÞ is a Logistic function that maps the value of UiT Vj to the ½0 1 interval.
R
Ii;j R
is an indicator function. If user ui rates POI vj , then Ii;j ¼ 1, otherwise it is 0.
To prevent overfitting, it is assumed that the potential feature vectors of users and
POIs follow a Gaussian distribution with a mean of 0, as follows:
Y
m
pðUjr2U Þ ¼ NðUi j0; r2U IÞ ð2Þ
i¼1
Y
n
pðVjr2v Þ ¼ NðVj j0; r2v IÞ ð3Þ
j¼1
1X m X n
kU Xm
kV Xn
LðR; U; VÞ ¼ R
Ii;j ðRij gðUiT Vj ÞÞ2 þ UiT Ui þ V T Vj ð4Þ
2 i¼1 j¼1 2 i¼1 2 j¼1 j
Finally, the prediction rate matrix R is obtained by the stochastic gradient descent
method (see Fig. 3).
In the next section, we will use the weight matrix to find the similarity between POIs.
The vectors x ¼ ðvi1 ; vi2 ; ; vin Þ and y ¼ ðvj1 ; vj2 ; ; vjn Þ represent different POIs
vectors in the weight matrix W. We calculate the difference between POIs through
Euclidean distance calculation, so that users can make personalized recommendations.
However, it is not enough to consider only the differences between POIs. We also need
to consider the geographical influence between POIs, so we will describe how to add
geographic influence in the recommendation algorithm.
f ðxÞ ¼ ex increases with the increase of x, which means that the physical distance
between two POIs increases, so the probability of being visited by the same user will
decrease. dðx; yÞ means that the difference between POIs increases with the increase of
distance. Finally, we recommend the top k minimum values to users.
4 Experiment
these users. The data set includes the user’s social network relationship, the user’s IDs,
the IDs of the checked-in POIs, the latitude and longitude of each checked-in POI, and
the time when the POIs checked in. In the pre-processing process of coarse-grained
division, fine-grained division and time division, we filtered out regional blocks with
thresholds below 10,000. In the experiment, the Gowalla dataset contains 15043 users
and visited a total of 106423 POIs.
Foursquare data in the experiment was collected from the United States, and the
check-in time span was from July 2011 to December 2012. A total of 386,975 check-in
locations were collected. The data set includes IDs of users and POIs, geographic
location and check-in time of POIs. The same as the previous data preprocessing, we
filter out the area blocks with threshold value less than 10000 in the preprocessing
process of coarse-grained division, fine-grained division and time division. In the
experiment, the Foursquare dataset contains 9698 users who visited a total of 54216
POIs. Among them, 80% were selected as the training set, and the remaining 20% were
used as the test set. The statistics of the data set are shown in Table 2.
1 X Si ðNÞ \ Vj
jUj
precision@N ¼ ð7Þ
jUj i¼1 N
1 X Si ðNÞ \ Vj
jUj
recall@N ¼ ð8Þ
jUj i¼1 jVj j
jUj indicates the number of users, Si ðNÞ indicates the recommendation of N POIs to
user ui , Vj indicates the set of POIs visited by the user in the test set, and N indicates the
number of recommended POIs. This article selects N ¼ f5; 10; 15; 20g to calculate the
precision and recall values respectively, and then serves as the evaluation index of this
article.
Multi-factor Fusion POI Recommendation Model 31
Figures 5 shows the changes in the precision and recall rates when w is ½0 1. As
can be seen in the figure, when the value of w is about 0.5, higher precision and recall
can be obtained. Therefore, in the following comparative experiment, the value of w is
set to 0.5 by default.
1. PMF [11]: According to the user’s historical rating data, the scores of the POIs that
are not rated are predicted, and the POIs with high ratings are recommended to the
user by prediction.
2. BPR [5]: The pairing method is adopted, and the item ranking is calculated by the
triples formed by the user and the item. The multiple groups finally formed con-
stitute a recommendation sequence to recommend to the user.
3. GeoMF [14]: Joint Geographical Modeling and Matrix Factorization for Point-of-
Interest Recommendation, 2014): By using the spatial clustering phenomenon of
user check-in behavior, the potential factors of users and POIs, the scope of users’
activities and the influence area of POIs are enhanced. The spatial clustering phe-
nomenon is captured and integrated into the matrix factorization, and the final
recommendation results are obtained through the matrix factorization.
4. PACE [23]: A deep neural structure that embeds user preferences and context
information. It learns the embedding of users and POIs together to predict users’
preferences for POIs and various contexts related to users and POIs.
5. GeoUMF [24]: The model considers the influence of geographical factors and user
factors. The objective function in the model considers the difference between the
ranking generated in the recommendation model and the actual ranking in the
check-in data and defines a consideration of the difference in POI access frequency
in the objective function Approximation.
Fig. 6. Performance of our method and other baseline methods on Gowalla dataset.
Multi-factor Fusion POI Recommendation Model 33
Fig. 7. Performance of our method and other baseline methods on Foursquare dataset.
According to the analysis in Fig. 6 and Fig. 7, PMF is used as a basic matrix
factorization algorithm, and its precision and recall are the lowest; BPR is more pre-
cision and recall than the basic PMF algorithm, each user is regarded as a relatively
independent individual to make personalized recommendation for users in BPR. The
improvement of precision and recall rate proves that personalized recommendation for
users can improve the quality of recommendation; GeoMF integrates the spatial
clustering phenomenon into the decomposition model and increases the potential
factors of users and items through the active region vector of users and the influence
region vector of POIs. It can be seen from the figure that the recommendation effect of
GeoMF algorithm is higher than that of the previous two algorithms, which shows that
the geographical factors cannot be ignored in POI recommendation, which is conducive
to improving the recommendation effect; We use the current popular deep recom-
mendation network PACE in the baseline model to show the excellent performance of
this model, and show the strong learning ability of deep neural network by comparing
with BPR and PMF; GeoUMF considers the influence of geographical factors and user
factors at the same time. Its performance is higher than other baseline models, which
also proves the superiority of adding geographical factors and user factors; The pre-
cision and recall of the UPEMF algorithm proposed in this paper are higher than those
of the previous algorithms. UPEMF combines the features of the previous three
algorithms to improve the precision and recall. We can see that the pre-processing
based on region and time division, and the introduction of geographical influence
factors and personalized recommendations to users can significantly improve the
quality of recommendations.
34 X. Ma et al.
In this paper, we use the relationship between user check-in behavior and user rating
behavior to improve POI recommendation. We learn the connections between users
and POIs and connections between POIs and POIs on LBSNs based on user check-in
behavior, user rating behavior, POIs geographic influence, and POIs similarity. We
model them under a unified POI recommendation framework. Our experimental results
demonstrate the importance of considering both user check-in behavior and user rating
behavior in explaining user behavior and improving the performance of POI recom-
mendations on the LBSN. In the future work, we will consider how to utilize the user’s
comment information on POIs to learn more user preferences and habits to improve the
recommendation quality.
References
1. Ren, X.: Context-aware probabilistic matrix factorization modeling for point-of-interest
recommendation. Neurocomputing 1(7), 38–55 (2017)
2. Ren, X.: Point-of-interest recommendation based on the user check-in behavior. Chin.
J. Comput. 40, 28–51 (2017)
3. Zhang, J.D., Chow, C.Y.: Point-of-interest recommendations in location-based social
networks. Sigspatial Spec. 7(3), 26–33 (2016)
4. He, J.: Inferring a personalized next point-of-interest recommendation model with latent
behavior patterns. In: Proceedings of the Thirtieth AAAI Conference on Artificial
Intelligence, AAAI, pp. 137–143. ACM (2016)
5. Rendle, S., Freudenthaler, C.: BPR: Bayesian personalized ranking from implicit feedback.
In: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence,
UAI, pp. 452–461. ACM (2009)
6. Gao, H.: Exploring temporal effects for location recommendation on location-based social
networks. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence,
AAAI, pp. 93–100. ACM (2016)
7. Gao, H.: Content-aware point of interest recommendation on location-based social networks.
In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI,
pp. 1721–1727. ACM (2015)
8. Zhao, S.: A survey of point-of-interest recommendation in location-based social networks.
In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI,
pp. 53–60. ResearchGate (2016)
9. Zhao, S., Zhao, T.: GT-SEER: geo-temporal sequential embedding rank for point-of-interest
recommendation. In: 2017 International World Wide Web Conference Committee, WWW,
pp. 153–162. ACM (2016)
10. Kalman, D.: A singularly valuable decomposition: the SVD of a matrix. Coll. Math. J. 1(27),
2–23 (1996)
11. Feng, S., Li, X.: Personalized ranking metric embedding for next new POI recommendation.
In: International Conference on Artificial Intelligence 2015, IJCAI, pp. 2069–2075. ACM
(2015)
12. Mnih, A., Ruslan, S.: Probabilistic matrix factorization. In: Neural Information Processing
Systems 2007, NIPS, pp. 1257–1264. ResearchGate (2008)
Multi-factor Fusion POI Recommendation Model 35
13. Jamali, M., Martin, E.: A matrix factorization technique with trust propagation for
recommendation in social networks. In: Proceedings of the 2010 ACM Conference on
Recommender Systems, ACM, pp. 135–142. ACM (2010)
14. Lian, D.: GeoMF: joint geographical modeling and matrix factorization for point-of-interest
recommendation. In: Proceedings of the 20th ACM SIGKDD International Conference on
Knowledge Discovery and Data Mining, KDD, pp. 831–840. ACM (2014)
15. Lian, D.: GeoMF++: scalable location recommendation via joint geographical modeling and
matrix factorization. ACM Trans. Inf. Syst. 36, 1–29 (2018)
16. Wang, H.: Exploiting POI-specific geographical influence for point-of-interest recommen-
dation. In: Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI,
pp. 3877–3883. ResearchGate (2018)
17. Liu, W.: Geo-ALM: POI recommendation by fusing geographical information and
adversarial learning mechanism. In: Twenty-Eighth International Joint Conference on
Artificial Intelligence, IJCAI, pp. 1807–1813 (2019)
18. Wu, H., Shao, J., Yin, H., Shen, H.T., Zhou, X.: Geographical constraint and temporal
similarity modeling for point-of-interest recommendation. In: Wang, J., et al. (eds.) WISE
2015. LNCS, vol. 9419, pp. 426–441. Springer, Cham (2015). https://doi.org/10.1007/978-
3-319-26187-4_40
19. Zhang, Z.: Fused matrix factorization with multi-tag, social and geographical influences for
POI recommendation. In: World Wide Web 2018, WWW, pp. 1135–1150. ResearchGate
(2018)
20. He, R., Kang, W.: Translation-based recommendation. In: Proceedings of the Eleventh ACM
Conference on Recommender Systems 2017, RECSYS, pp. 161–169. ACM (2017)
21. Wang, Y.: Collaborative filtering recommendation algorithm based on improved clustering
and matrix factorization. J. Comput. Appl., 1001–1006 (2018)
22. Zhang, S.: Metric factorization: recommendation beyond matrix factorization. Inf. Retr. 6(4),
(2018)
23. Yang, C.: Bridging collaborative filtering and semi-supervised learning: a neural approach
for POI recommendation. In: Knowledge Discovery and Data Mining 2017, KDD,
pp. 1245–1254. ResearchGate (2017)
24. Xu, Y., Li, Y.: A multi-factor influencing POI recommendation model based on matrix
factorization. In: 2018 Tenth International Conference on Advanced Computational
Intelligence, ICACI, pp. 514–519 (2018)