About MIND

MIcrosoft News Dataset (MIND) is a large-scale dataset for news recommendation research. It was collected from anonymized behavior logs of Microsoft News website. The mission of MIND is to serve as a benchmark dataset for news recommendation and facilitate the research in news recommendation and recommender systems area.

MIND contains about 160k English news articles and more than 15 million impression logs generated by 1 million users. Every news article contains rich textual content including title, abstract, body, category and entities. Each impression log contains the click events, non-clicked events and historical news click behaviors of this user before this impression. To protect user privacy, each user was de-linked from the production system when securely hashed into an anonymized ID. For more detailed information about the MIND dataset, you can refer to the following paper:

If you are interested in using this dataset in your research work, welcome to cite this paper:

Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu and Ming Zhou. MIND: A Large-scale Dataset for News Recommendation. ACL 2020.


Download

The MIND dataset is free to download for research purposes under Microsoft Research License Terms. Before you download the dataset, please read these terms and click below button to confirm that you agree to them.


This dataset can support many researches on news recommendation, and can be downloaded at:

We also provide the link to Microsoft Azure Open Datasets for eaiser access to our large dataset on cloud platform:

For more details about the data formats, please refer to this document:


In addition, to help the researchers get familiar with our data and run quick experiments, we release a small version of the MIND dataset by randomly sampling 50,000 users and their behavior logs from the MIND dataset. We name this dataset MIND-small. The training and validation sets of MIND-small can be downloaded at:


The implementation of several existing news recommendation methods and general recommendation methods can be found at Microsoft Recommenders.

Following is a step-by-step tutorial for generating predictions on the dataset:

Workshop

We are holding the 1st International Workshop on News Recommendation and Intelligence, which is colocated with The Web Conference 2021. We solicit both research and technical report papers in all aspects of news recommendation and intelligence. The submission due is January 25, 2021. More details can be found on the workshop page.

Leaderboard

Rank Team AUC MRR nDCG@5 nDCG@10

1

Oct. 05, 2021
UniUM-Fastformer-Pretrain 0.7304 0.3770 0.4180 0.4718

2

Sept. 02, 2021
MINER 0.7275 0.3724 0.4102 0.4661

3

Aug. 08, 2021
UniUM-Fastformer 0.7268 0.3745 0.4151 0.4684

4

Mar. 04, 2021
UniUM 0.7243 0.3706 0.4101 0.4644

5

Feb. 27, 2021
chenghuige 0.7209 0.3676 0.4040 0.4597

6

Feb. 26, 2021
UNBERT 0.7207 0.3677 0.4041 0.4602

7

Jun. 21, 2021
wsm_SotA 0.7196 0.3636 0.3998 0.4560

8

Jul. 02, 2021
only2233 0.7174 0.3660 0.4022 0.4584

9

Oct. 23, 2020
fuxictr 0.7143 0.3613 0.3964 0.4526

10

Oct. 23, 2020
wcy419hh 0.7143 0.3616 0.3967 0.4529

11

Oct. 23, 2020
dtsnu 0.7114 0.3568 0.3916 0.4485

12

Oct. 23, 2020
started2givingup 0.7113 0.3585 0.3933 0.4498

13

Mar. 01, 2021
akirasosa 0.7103 0.3539 0.3876 0.4445

14

May. 27, 2021
SFI 0.7101 0.3577 0.3922 0.4485

15

Oct. 23, 2020
oahciy 0.7096 0.3540 0.3883 0.4454

16

Oct. 23, 2020
WONNIU 0.7095 0.3569 0.3916 0.4481

17

Jun. 13, 2021
wsm_88888888 0.7092 0.3541 0.3881 0.4448

18

Aug. 10, 2021
martin_bi 0.7085 0.3581 0.3926 0.4489

19

Feb. 01, 2021
codefish 0.7082 0.3560 0.3897 0.4457

20

Jun. 10, 2021
namespace-Pt 0.7067 0.3559 0.3896 0.4459

21

Oct. 23, 2020
NoahRS 0.7061 0.3552 0.3895 0.4459

22

Oct. 19, 2021
doubleQ 0.7059 0.3514 0.3847 0.4418

23

Jul. 18, 2021
DistillRec 0.7057 0.3552 0.3896 0.4458

24

Feb. 04, 2021
littlefile 0.7052 0.3535 0.3869 0.4432

25

Oct. 23, 2020
Ravox 0.7048 0.3505 0.3845 0.4416

26

Jun. 14, 2021
guiltrex 0.7038 0.3504 0.3838 0.4408

27

Oct. 23, 2020
Qinne 0.7032 0.3496 0.3830 0.4397

28

Apr. 27, 2021
MengyanZhang 0.7031 0.3496 0.3833 0.4403

29

Feb. 07, 2021
MIND_Organizer 0.7012 0.3482 0.3808 0.4377

30

Oct. 25, 2021
veason 0.6995 0.3474 0.3801 0.4370

31

Oct. 23, 2020
xyzhang 0.6980 0.3476 0.3814 0.4383

32

Oct. 23, 2020
YangZhenghong 0.6979 0.3480 0.3809 0.4377

33

Oct. 23, 2020
gcc_microsoft 0.6979 0.3479 0.3806 0.4373

34

Oct. 23, 2020
huailei 0.6968 0.3492 0.3812 0.4386

35

Oct. 23, 2020
hanyan 0.6964 0.3441 0.3764 0.4336

36

Feb. 21, 2021
Chenbin_Zhang 0.6960 0.3469 0.3791 0.4356

37

Jun. 20, 2021
ml4lyfe 0.6957 0.3452 0.3778 0.4350

38

Oct. 23, 2020
lixmcm 0.6952 0.3438 0.3765 0.4335

39

Oct. 17, 2021
tj2364 0.6951 0.3409 0.3725 0.4301

40

Oct. 23, 2020
duchunning 0.6951 0.3428 0.3753 0.4324

41

Oct. 23, 2020
fanxiaoxing 0.6949 0.3448 0.3770 0.4336

42

Apr. 08, 2021
libowei 0.6948 0.3456 0.3773 0.4338

43

Jan. 03, 2021
Chiu 0.6946 0.3444 0.3759 0.4326

44

Feb. 02, 2021
Ruixinhua 0.6943 0.3433 0.3748 0.4318

45

Oct. 23, 2020
overlord 0.6942 0.3445 0.3767 0.4332

46

Oct. 23, 2020
id500 0.6935 0.3451 0.3773 0.4344

47

Dec 03, 2020
msj 0.6932 0.3432 0.3745 0.4312

48

Aug. 19, 2021
kuailede_cr 0.6931 0.3424 0.3738 0.4309

49

Jun. 20, 2021
wsm_victor 0.6926 0.3441 0.3762 0.4325

50

Jun. 20, 2021
JamesCYL 0.6926 0.3441 0.3762 0.4325

51

Apr. 24, 2021
chenyipu 0.6925 0.3416 0.3731 0.4304

52

Oct. 23, 2020
Ironball 0.6923 0.3440 0.3778 0.4351

53

Apr. 13, 2021
peijie 0.6918 0.3393 0.3708 0.4282

54

Jun. 19, 2021
breezedeus 0.6915 0.3409 0.3723 0.4296

55

Jan. 04, 2021
Tmail 0.6915 0.3429 0.3737 0.4302

56

Jun. 10, 2021
ZJUHW 0.6914 0.3448 0.3771 0.4337

57

Oct. 23, 2020
fit4you 0.6910 0.3413 0.3732 0.4307

58

Jun. 17, 2021
QQs 0.6903 0.3419 0.3735 0.4299

59

Oct. 23, 2020
AndreaChao 0.6903 0.3413 0.3727 0.4299

60

Jun. 17, 2021
Bravooo 0.6902 0.3419 0.3735 0.4299

61

Oct. 23, 2020
Ivy 0.6901 0.3414 0.3726 0.4299

62

Jun. 21, 2021
wsm_EasternHarvard 0.6899 0.3385 0.3685 0.4255

63

Jan. 25, 2021
Nick1998 0.6897 0.3380 0.3686 0.4258

64

May. 31, 2021
SunYunLong 0.6896 0.3397 0.3709 0.4282

65

Oct. 23, 2020
changebin 0.6888 0.3396 0.3706 0.4273

66

Jan. 12, 2021
saltyfish 0.6886 0.3357 0.3667 0.4239

67

Jun. 20, 2021
Sony 0.6884 0.3382 0.3690 0.4255

68

Jun. 19, 2021
chuyueh 0.6882 0.3398 0.3709 0.4273

69

Jan. 28, 2021
kkq10466 0.6872 0.3359 0.3665 0.4239

70

Sept. 02, 2021
ReleaseWang 0.6867 0.3372 0.3674 0.4248

71

Sept. 01, 2020
yupei 0.6867 0.3404 0.3721 0.4288

72

Feb. 22, 2021
qxe34517 0.6866 0.3344 0.3651 0.4226

73

Jan. 15, 2021
fzy37920 0.6866 0.3357 0.3664 0.4236

74

Sept. 24, 2021
HJS_TJU 0.6865 0.3377 0.3681 0.4252

75

Jan. 04, 2021
alexchiu 0.6864 0.3360 0.3659 0.4234

76

Oct. 23, 2020
Tsar 0.6862 0.3374 0.3676 0.4253

77

Sept. 01, 2020
majinc 0.6862 0.3397 0.3705 0.4274

78

Jan. 29, 2021
Spring_945 0.6861 0.3379 0.3689 0.4256

79

Jan. 02, 2021
NAML 0.6861 0.3377 0.3688 0.4260

80

Nov. 20, 2020
ConnollyLeon 0.6860 0.3363 0.3668 0.4237

81

Sept. 24, 2021
HerbertOnRoad 0.6858 0.3368 0.3670 0.4239

82

Jun. 19, 2021
tingting0119 0.6858 0.3358 0.3664 0.4234

83

Jul. 21, 2021
csb266 0.6853 0.3377 0.3678 0.4247

84

Feb. 10, 2021
ybm15387 0.6851 0.3322 0.3624 0.4201

85

Oct. 23, 2020
heroddaji 0.6845 0.3376 0.3677 0.4244

86

Feb. 03, 2021
Cora 0.6836 0.3356 0.3665 0.4235

87

Oct. 25, 2020
faysir 0.6836 0.3343 0.3644 0.4219

88

Aug. 27, 2020
CyberFish 0.6834 0.3373 0.3683 0.4258

89

Feb. 10, 2021
xqu19316 0.6832 0.3324 0.3623 0.4200

90

Feb. 01, 2021
Codle 0.6828 0.3347 0.3648 0.4219

91

Oct. 23, 2020
again_and_again 0.6828 0.3365 0.3665 0.4240

92

Oct. 23, 2020
xinghuaz 0.6827 0.3385 0.3691 0.4259

93

Aug. 28, 2020
amgis3 0.6827 0.3320 0.3615 0.4196

94

Jun. 15, 2021
wsm_baseline 0.6824 0.3351 0.3656 0.4225

95

Sept. 23, 2021
wzz2579421845 0.6817 0.3316 0.3605 0.4177

96

Jun. 18, 2021
wsm-soslab 0.6815 0.3358 0.3663 0.4234

97

Oct. 23, 2020
dengjia284 0.6814 0.3325 0.3614 0.4192

98

Sept. 19, 2021
clilyn 0.6809 0.3371 0.3675 0.4243

99

Oct. 23, 2020
ustc_jingang 0.6809 0.3337 0.3633 0.4208

100

Oct. 09, 2021
AAU-Bruno 0.6807 0.3338 0.3634 0.4207

101

Aug. 27, 2021
yangyongqiang1 0.6800 0.3337 0.3638 0.4207

102

Oct. 23, 2020
qqyysg 0.6799 0.3336 0.3644 0.4213

103

Mar. 15, 2021
hvv 0.6798 0.3352 0.3655 0.4223

104

Mar. 01, 2021
hapoyige 0.6793 0.3341 0.3647 0.4215

105

Nov. 13, 2020
YHu 0.6790 0.3338 0.3624 0.4192

106

Jul. 25, 2021
LiJT 0.6789 0.3321 0.3621 0.4188

107

Nov. 30, 2020
finegrained 0.6787 0.3346 0.3653 0.4221

108

Mar. 25, 2021
wangwenhua 0.6785 0.3316 0.3611 0.4181

109

Aug. 29, 2020
Reto-hitsz 0.6783 0.3288 0.3575 0.4153

110

May. 26, 2021
xuhongqing 0.6779 0.3287 0.3567 0.4140

111

Oct. 23, 2020
simple2better 0.6766 0.3311 0.3609 0.4184

112

Oct. 23, 2020
shahnawaz 0.6766 0.3282 0.3576 0.4149

113

Apr. 11, 2021
hmguo 0.6763 0.3297 0.3591 0.4163

114

Feb. 03, 2021
Autumn 0.6754 0.3292 0.3581 0.4154

115

Jun. 19, 2021
wsm_KoreaMoos 0.6748 0.3285 0.3569 0.4140

116

Oct. 23, 2020
zidane4ever21 0.6710 0.3236 0.3523 0.4093

117

Jun. 20, 2021
jaing885 0.6708 0.3256 0.3532 0.4105

118

Apr. 09, 2021
ab25 0.6705 0.3228 0.3504 0.4083

119

Feb. 09, 2021
OpenMind 0.6700 0.3277 0.3559 0.4130

120

Oct. 23, 2020
dust 0.6691 0.3267 0.3539 0.4109

121

Aug. 14, 2021
laiping 0.6690 0.3260 0.3543 0.4114

122

Jun. 06, 2021
shuix007 0.6689 0.3225 0.3499 0.4079

123

Apr. 04, 2021
Rachelxuan11 0.6687 0.3254 0.3525 0.4096

124

Apr. 21, 2021
Locnqvn 0.6661 0.3206 0.3478 0.4057

125

Mar. 17, 2021
jazzzminewang 0.6659 0.3236 0.3502 0.4074

126

Nov. 28, 2020
TJ_Arthur 0.6646 0.3185 0.3460 0.4046

127

Feb. 12, 2021
akjindal53244 0.6638 0.3191 0.3466 0.4042

128

Jan. 12, 2021
freddy_2077 0.6614 0.3205 0.3473 0.4042

129

Apr. 28, 2021
Hieulm 0.6594 0.3169 0.3436 0.4005

130

Mar. 22, 2021
pd 0.6575 0.3189 0.3458 0.4025

131

Mar. 25, 2021
xulongteng 0.6571 0.3179 0.3446 0.4014

132

Jan. 29, 2021
Silence 0.6570 0.3141 0.3384 0.3967

133

Oct. 23, 2020
aqweteddy 0.6566 0.3173 0.3425 0.3989

134

Apr. 04, 2021
KGN 0.6564 0.3182 0.3442 0.4010

135

Oct. 23, 2020
xcw 0.6554 0.3172 0.3434 0.4000

136

Jun. 02, 2021
wsm_Mark4PM 0.6550 0.3150 0.3406 0.3982

137

Mar. 02, 2021
christineC2021_1 0.6546 0.3133 0.3389 0.3963

138

Mar. 07, 2021
jingqinghe 0.6543 0.3166 0.3428 0.3995

139

Apr. 25, 2021
ThachAnh 0.6524 0.3128 0.3370 0.3950

140

Mar. 07, 2021
mapingshuo 0.6521 0.3147 0.3408 0.3978

141

Oct. 23, 2020
AND-OR 0.6506 0.3079 0.3320 0.3898

142

Oct. 23, 2020
drew 0.6486 0.3087 0.3333 0.3905

143

Jun. 10, 2021
changecandy 0.6481 0.3114 0.3352 0.3922

144

Apr. 07, 2021
christineC2021 0.6479 0.2996 0.3214 0.3805

145

Mar. 04, 2021
feature 0.6477 0.3125 0.3382 0.3946

146

Jan. 25, 2021
cynricshu 0.6454 0.3000 0.3218 0.3811

147

Aug. 27, 2020
gaojx 0.6342 0.3112 0.3358 0.3919

148

Feb. 23, 2021
TerryMa 0.6251 0.2919 0.3141 0.3718

149

Jan. 23, 2021
ifan 0.6204 0.2847 0.3039 0.3625

150

Jun. 19, 2021
WSM_winwin 0.6166 0.2949 0.3166 0.3730

151

Oct. 23, 2020
tcchiang 0.5950 0.2794 0.2974 0.3551

152

Mar. 05, 2021
Mluleki 0.5848 0.2641 0.2778 0.3352

153

Aug. 26, 2020
learner 0.5847 0.2648 0.2786 0.3361

154

Jun. 07, 2021
chang861224 0.5703 0.2769 0.2945 0.3495

155

Feb. 12, 2021
lwj 0.5519 0.2469 0.2573 0.3136

156

Oct. 25, 2021
surupendu 0.5259 0.2408 0.2495 0.3046

157

Jun. 01, 2021
YJack0000 0.5246 0.2364 0.2422 0.2990

158

May. 13, 2021
Brucenccu 0.5221 0.2328 0.2380 0.2938

159

Jul. 02, 2021
Leon-chang 0.5207 0.2318 0.2385 0.2948

160

Jan. 06, 2021
zichongli 0.5183 0.2348 0.2427 0.2983

161

Aug. 24, 2020
cs880141 0.5180 0.2327 0.2395 0.2953

162

Jan. 06, 2021
xhran2011 0.5170 0.2339 0.2416 0.2972

163

Jan. 06, 2021
xhran2010 0.5170 0.2339 0.2416 0.2972

164

Jan. 18, 2021
christineC2021_2 0.5130 0.2296 0.2363 0.2924

165

Aug. 26, 2020
cdj0311 0.5059 0.2290 0.2350 0.2900

166

Jun. 18, 2021
DaveWuuu 0.5020 0.2236 0.2310 0.2872

167

Aug. 26, 2020
zhoubang1 0.5009 0.2256 0.2316 0.2869

168

Jan. 05, 2021
rockandroll 0.5003 0.2239 0.2294 0.2849

169

Aug. 25, 2020
bird 0.5002 0.2248 0.2304 0.2862

170

Jun. 06, 2021
david116711 0.5000 0.2239 0.2294 0.2849