FileNotFoundError data/%s.pkl

[amybilkis1]

can someone help me to find this file(data/%s.pkl) ? Thanks

#step 1 - load data
with open('data/%s.pkl', 'rb') as fp:
heads, desc, keywords = pickle.load(fp)

---

FileNotFoundError Traceback (most recent call last)
in ()
1 #step 1 - load data
----> 2 with open('data/%s.pkl', 'rb') as fp:
3 heads, desc, keywords = pickle.load(fp)

FileNotFoundError: [Errno 2] No such file or directory: 'data/%s.pkl'

[rsbohn12]

It is looking for 'data/tokens.pkl' -- which I [Siraj] assume you already have.

[amybilkis1]

I'm new in deep learning in and i am non good in english. Please explain me. Is it the dataset ? Because when i use it gives an error

[rsbohn12]

It should read with open('data/%s.pkl' % FN0) as fp: -- This replaces the %s with the actual file.

You have to download the SignalMedia dataset http://research.signalmedia.co/newsir16/signal-dataset.html and process it to create the .pkl file.

[amybilkis1]

Please can you tell me how to process it step by step ? Because i just dump it to have the corresponding pkl file but it don't work. Thanks !

[Nitinkmr]

I also had the same issue. The below code should convert the data to the pickle file

heads = []
descs = []
keywords = []
for filename in range(numOfFiles):
    with open('path to file' + '.txt','r') as fp:
        text = fp.read()
        temp = text
        heads.append(temp.split("\n")[0])
        descs.append(text) 
        keywords.append(None)
        
with open('data.pickle', 'wb') as f:
     pickle.dump((heads,descs,keywords),f)
            

Any suggestions/ guidance would be appreciated.
Thanks

[amybilkis1]

I try it but i win an errer. WinError 6 desrcriptor none valid

[Nitinkmr]

works for me. I am using python 3.

[amybilkis1]

I'm also using python 3.5

[amybilkis1]

OK Thanks to have try to help me

[rsbohn12]

Might have better luck with this: https://towardsdatascience.com/how-to-create-data-products-that-are-magical-using-sequence-to-sequence-models-703f86a231f8

[luyanan1995]

hello,i have the same issue,have you solved the problem?and the dataset about NewsIR'16 couldn't be download ,can you sent it to me?my email:1244141380@qq.com，thank you for your help,thank you very much

[kiranvarma26]

Could you post the entire project with the dataset, pre and post processing and model building.

[luyanan1995]

https://drive.google.com/open?id=1dqHMlfPstrzTPPUSmR-8owNt6DT6g2Jq please download dataset

…

------------------ 原始邮件 ------------------ 发件人: "kiranvarma26"<notifications@github.com>; 发送时间: 2018年1月29日(星期一) 下午3:35 收件人: "llSourcell/How_to_make_a_text_summarizer"<How_to_make_a_text_summarizer@noreply.github.com>; 抄送: "浅笑々流年"<1244141380@qq.com>; "Comment"<comment@noreply.github.com>; 主题: Re: [llSourcell/How_to_make_a_text_summarizer] FileNotFoundErrordata/%s.pkl (#11) Could you post the entire project with the dataset, pre and post processing and model building. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

[sonu628]

how to convert .jsonl to pickle format?

[KevinDanikowski]

This works for the jsonl file (jsonl is single line objects with no comma separating them, look up jsonlines)

import _pickle as pickle
import jsonlines

heads = []
descs = []
keywords = []

with jsonlines.open('../data/too-large-for-git/signalmedia-1m' + '.jsonl','r') as reader:
    i = 0
    for obj in reader:
        if i < 1000:
            i += 1
            head = obj["title"]
            desc = [s.strip() for s in obj["content"].splitlines()]
            heads.append(head)
            descs.append(desc)
            keywords.append(None)
        else:
            break
        
# print(heads, descs, keywords)
with open('../data/tokens.pkl', 'wb') as f:
    pickle.dump((heads,descs,keywords),f)

my github for the project (still in progress as of 4/30/2018) https://github.com/KevinDanikowski/nlp-tensorflow-practice/tree/master/text_summarizer