About MIND

MIcrosoft News Dataset (MIND) is a large-scale dataset for news recommendation research. It was collected from anonymized behavior logs of Microsoft News website. The mission of MIND is to serve as a benchmark dataset for news recommendation and facilitate the research in news recommendation and recommender systems area.

MIND contains about 160k English news articles and more than 15 million impression logs generated by 1 million users. Every news article contains rich textual content including title, abstract, body, category and entities. Each impression log contains the click events, non-clicked events and historical news click behaviors of this user before this impression. To protect user privacy, each user was de-linked from the production system when securely hashed into an anonymized ID. For more detailed information about the MIND dataset, you can refer to the following paper:

If you are interested in using this dataset in your research work, welcome to cite this paper:

Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu and Ming Zhou. MIND: A Large-scale Dataset for News Recommendation. ACL 2020.


Download

The MIND dataset is free to download for research purposes under Microsoft Research License Terms. Before you download the dataset, please read these terms and click below button to confirm that you agree to them.


This dataset can support many researches on news recommendation, and can be downloaded at:

We also provide the link to Microsoft Azure Open Datasets for eaiser access to our large dataset on cloud platform:

For more details about the data formats, please refer to this document:


In addition, to help the researchers get familiar with our data and run quick experiments, we release a small version of the MIND dataset by randomly sampling 50,000 users and their behavior logs from the MIND dataset. We name this dataset MIND-small. The training and validation sets of MIND-small can be downloaded at:


The implementation of several existing news recommendation methods and general recommendation methods can be found at Microsoft Recommenders.

Following is a step-by-step tutorial for generating predictions on the dataset:

Workshop

We are holding the 1st International Workshop on News Recommendation and Intelligence, which is colocated with The Web Conference 2021. We solicit both research and technical report papers in all aspects of news recommendation and intelligence. The submission due is January 25, 2021. More details can be found on the workshop page.

Leaderboard

Rank Team AUC MRR nDCG@5 nDCG@10

1

Mar. 04, 2021
UniUM 0.7243 0.3706 0.4101 0.4644

2

Feb. 27, 2021
chenghuige 0.7209 0.3676 0.4040 0.4597

3

Feb. 26, 2021
UNBERT 0.7207 0.3677 0.4041 0.4602

4

Oct. 23, 2020
fuxictr 0.7143 0.3613 0.3964 0.4526

5

Oct. 23, 2020
wcy419hh 0.7143 0.3616 0.3967 0.4529

6

Oct. 23, 2020
doubleQ 0.7121 0.3597 0.3944 0.4508

7

Oct. 23, 2020
dtsnu 0.7114 0.3568 0.3916 0.4485

8

Oct. 23, 2020
started2givingup 0.7113 0.3585 0.3933 0.4498

9

Mar. 01, 2021
akirasosa 0.7103 0.3539 0.3876 0.4445

10

Oct. 23, 2020
oahciy 0.7096 0.3540 0.3883 0.4454

11

Oct. 23, 2020
WONNIU 0.7095 0.3569 0.3916 0.4481

12

Feb. 01, 2021
codefish 0.7082 0.3560 0.3897 0.4457

13

May. 05, 2021
Pt 0.7066 0.3555 0.3889 0.4455

14

Oct. 23, 2020
NoahRS 0.7061 0.3552 0.3895 0.4459

15

Feb. 04, 2021
littlefile 0.7052 0.3535 0.3869 0.4432

16

Oct. 23, 2020
Ravox 0.7048 0.3505 0.3845 0.4416

17

Oct. 23, 2020
Qinne 0.7032 0.3496 0.3830 0.4397

18

Apr. 27, 2021
MengyanZhang 0.7031 0.3496 0.3833 0.4403

19

Feb. 07, 2021
MIND_Organizer 0.7012 0.3482 0.3808 0.4377

20

Oct. 23, 2020
xyzhang 0.6980 0.3476 0.3814 0.4383

21

Oct. 23, 2020
YangZhenghong 0.6979 0.3480 0.3809 0.4377

22

Oct. 23, 2020
gcc_microsoft 0.6979 0.3479 0.3806 0.4373

23

Oct. 23, 2020
huailei 0.6968 0.3492 0.3812 0.4386

24

Oct. 23, 2020
hanyan 0.6964 0.3441 0.3764 0.4336

25

Feb. 21, 2021
Chenbin_Zhang 0.6960 0.3469 0.3791 0.4356

26

Oct. 23, 2020
lixmcm 0.6952 0.3438 0.3765 0.4335

27

Oct. 23, 2020
duchunning 0.6951 0.3428 0.3753 0.4324

28

Oct. 23, 2020
fanxiaoxing 0.6949 0.3448 0.3770 0.4336

29

Apr. 08, 2021
libowei 0.6948 0.3456 0.3773 0.4338

30

Jan. 03, 2021
Chiu 0.6946 0.3444 0.3759 0.4326

31

Feb. 02, 2021
Ruixinhua 0.6943 0.3433 0.3748 0.4318

32

Oct. 23, 2020
overlord 0.6942 0.3445 0.3767 0.4332

33

Oct. 23, 2020
veason 0.6941 0.3435 0.3751 0.4321

34

Oct. 23, 2020
id500 0.6935 0.3451 0.3773 0.4344

35

Dec 03, 2020
msj 0.6932 0.3432 0.3745 0.4312

36

Apr. 24, 2021
chenyipu 0.6925 0.3416 0.3731 0.4304

37

Oct. 23, 2020
Ironball 0.6923 0.3440 0.3778 0.4351

38

Apr. 13, 2021
peijie 0.6918 0.3393 0.3708 0.4282

39

Jan. 04, 2021
Tmail 0.6915 0.3429 0.3737 0.4302

40

Oct. 23, 2020
fit4you 0.6910 0.3413 0.3732 0.4307

41

Oct. 23, 2020
AndreaChao 0.6903 0.3413 0.3727 0.4299

42

Oct. 23, 2020
Ivy 0.6901 0.3414 0.3726 0.4299

43

Jan. 25, 2021
Nick1998 0.6897 0.3380 0.3686 0.4258

44

May. 06, 2021
guiltrex 0.6891 0.3397 0.3706 0.4281

45

Oct. 23, 2020
changebin 0.6888 0.3396 0.3706 0.4273

46

Jan. 12, 2021
saltyfish 0.6886 0.3357 0.3667 0.4239

47

Jan. 28, 2021
kkq10466 0.6872 0.3359 0.3665 0.4239

48

Sept. 01, 2020
yupei 0.6867 0.3404 0.3721 0.4288

49

Feb. 22, 2021
qxe34517 0.6866 0.3344 0.3651 0.4226

50

Jan. 15, 2021
fzy37920 0.6866 0.3357 0.3664 0.4236

51

Jan. 04, 2021
alexchiu 0.6864 0.3360 0.3659 0.4234

52

Oct. 23, 2020
Tsar 0.6862 0.3374 0.3676 0.4253

53

Sept. 01, 2020
majinc 0.6862 0.3397 0.3705 0.4274

54

Jan. 29, 2021
Spring_945 0.6861 0.3379 0.3689 0.4256

55

Jan. 02, 2021
NAML 0.6861 0.3377 0.3688 0.4260

56

Nov. 20, 2020
ConnollyLeon 0.6860 0.3363 0.3668 0.4237

57

Feb. 10, 2021
ybm15387 0.6851 0.3322 0.3624 0.4201

58

Oct. 23, 2020
heroddaji 0.6845 0.3376 0.3677 0.4244

59

Feb. 03, 2021
Cora 0.6836 0.3356 0.3665 0.4235

60

Oct. 25, 2020
faysir 0.6836 0.3343 0.3644 0.4219

61

Jan. 24, 2021
csb266 0.6834 0.3329 0.3629 0.4204

62

Aug. 27, 2020
CyberFish 0.6834 0.3373 0.3683 0.4258

63

Feb. 10, 2021
xqu19316 0.6832 0.3324 0.3623 0.4200

64

Feb. 01, 2021
Codle 0.6828 0.3347 0.3648 0.4219

65

Oct. 23, 2020
again_and_again 0.6828 0.3365 0.3665 0.4240

66

Oct. 23, 2020
xinghuaz 0.6827 0.3385 0.3691 0.4259

67

Aug. 28, 2020
amgis3 0.6827 0.3320 0.3615 0.4196

68

Oct. 23, 2020
dengjia284 0.6814 0.3325 0.3614 0.4192

69

Oct. 23, 2020
ustc_jingang 0.6809 0.3337 0.3633 0.4208

70

Oct. 23, 2020
qqyysg 0.6799 0.3336 0.3644 0.4213

71

Mar. 15, 2021
hvv 0.6798 0.3352 0.3655 0.4223

72

Apr. 20, 2021
ReleaseWang 0.6794 0.3331 0.3639 0.4212

73

Mar. 01, 2021
hapoyige 0.6793 0.3341 0.3647 0.4215

74

Nov. 13, 2020
YHu 0.6790 0.3338 0.3624 0.4192

75

Apr. 19, 2021
SunYunLong 0.6787 0.3343 0.3638 0.4214

76

Nov. 30, 2020
finegrained 0.6787 0.3346 0.3653 0.4221

77

Mar. 25, 2021
wangwenhua 0.6785 0.3316 0.3611 0.4181

78

Aug. 29, 2020
Reto-hitsz 0.6783 0.3288 0.3575 0.4153

79

Oct. 23, 2020
simple2better 0.6766 0.3311 0.3609 0.4184

80

Oct. 23, 2020
shahnawaz 0.6766 0.3282 0.3576 0.4149

81

Apr. 11, 2021
hmguo 0.6763 0.3297 0.3591 0.4163

82

Feb. 03, 2021
Autumn 0.6754 0.3292 0.3581 0.4154

83

Oct. 23, 2020
zidane4ever21 0.6710 0.3236 0.3523 0.4093

84

Apr. 09, 2021
ab25 0.6705 0.3228 0.3504 0.4083

85

Feb. 09, 2021
OpenMind 0.6700 0.3277 0.3559 0.4130

86

Oct. 23, 2020
dust 0.6691 0.3267 0.3539 0.4109

87

Apr. 04, 2021
Rachelxuan11 0.6687 0.3254 0.3525 0.4096

88

Apr. 21, 2021
Locnqvn 0.6661 0.3206 0.3478 0.4057

89

Mar. 17, 2021
jazzzminewang 0.6659 0.3236 0.3502 0.4074

90

Nov. 28, 2020
TJ_Arthur 0.6646 0.3185 0.3460 0.4046

91

Feb. 12, 2021
akjindal53244 0.6638 0.3191 0.3466 0.4042

92

Jan. 12, 2021
freddy_2077 0.6614 0.3205 0.3473 0.4042

93

Apr. 28, 2021
Hieulm 0.6594 0.3169 0.3436 0.4005

94

Mar. 22, 2021
pd 0.6575 0.3189 0.3458 0.4025

95

Mar. 25, 2021
xulongteng 0.6571 0.3179 0.3446 0.4014

96

Jan. 29, 2021
Silence 0.6570 0.3141 0.3384 0.3967

97

Oct. 23, 2020
aqweteddy 0.6566 0.3173 0.3425 0.3989

98

Apr. 04, 2021
KGN 0.6564 0.3182 0.3442 0.4010

99

Oct. 23, 2020
xcw 0.6554 0.3172 0.3434 0.4000

100

Mar. 02, 2021
christineC2021_1 0.6546 0.3133 0.3389 0.3963

101

Mar. 07, 2021
jingqinghe 0.6543 0.3166 0.3428 0.3995

102

Apr. 25, 2021
ThachAnh 0.6524 0.3128 0.3370 0.3950

103

Apr. 25, 2021
breezedeus 0.6523 0.3065 0.3298 0.3883

104

Mar. 07, 2021
mapingshuo 0.6521 0.3147 0.3408 0.3978

105

Oct. 23, 2020
HJS_TJU 0.6512 0.3122 0.3357 0.3934

106

Oct. 23, 2020
AND-OR 0.6506 0.3079 0.3320 0.3898

107

Oct. 23, 2020
drew 0.6486 0.3087 0.3333 0.3905

108

Apr. 07, 2021
christineC2021 0.6479 0.2996 0.3214 0.3805

109

Mar. 04, 2021
feature 0.6477 0.3125 0.3382 0.3946

110

Jan. 25, 2021
cynricshu 0.6454 0.3000 0.3218 0.3811

111

Apr. 11, 2021
changecandy 0.6368 0.3000 0.3219 0.3799

112

Aug. 27, 2020
gaojx 0.6342 0.3112 0.3358 0.3919

113

Feb. 23, 2021
TerryMa 0.6251 0.2919 0.3141 0.3718

114

Jan. 23, 2021
ifan 0.6204 0.2847 0.3039 0.3625

115

Oct. 23, 2020
tcchiang 0.5950 0.2794 0.2974 0.3551

116

Mar. 05, 2021
Mluleki 0.5848 0.2641 0.2778 0.3352

117

Aug. 26, 2020
learner 0.5847 0.2648 0.2786 0.3361

118

Feb. 12, 2021
lwj 0.5519 0.2469 0.2573 0.3136

119

Oct. 23, 2020
only2233 0.5352 0.2408 0.2507 0.3075

120

Jan. 06, 2021
zichongli 0.5183 0.2348 0.2427 0.2983

121

Jan. 29, 2021
HerbertOnRoad 0.5182 0.2343 0.2388 0.2936

122

Aug. 24, 2020
cs880141 0.5180 0.2327 0.2395 0.2953

123

Jan. 06, 2021
xhran2011 0.5170 0.2339 0.2416 0.2972

124

Jan. 06, 2021
xhran2010 0.5170 0.2339 0.2416 0.2972

125

May. 05, 2021
namespace-Pt 0.5150 0.2269 0.2340 0.2906

126

Apr. 27, 2021
Brucenccu 0.5144 0.2301 0.2366 0.2920

127

Jan. 18, 2021
christineC2021_2 0.5130 0.2296 0.2363 0.2924

128

Aug. 26, 2020
cdj0311 0.5059 0.2290 0.2350 0.2900

129

Aug. 26, 2020
zhoubang1 0.5009 0.2256 0.2316 0.2869

130

Jan. 05, 2021
rockandroll 0.5003 0.2239 0.2294 0.2849

131

Aug. 25, 2020
bird 0.5002 0.2248 0.2304 0.2862