鏈接：致命錯誤LNK1104：無法打開文件'C：\\ Users \\ hp \\ .pyxbld \\ lib.win32-2.7 \\ gensim \\ models \\ word2vec_inner.pyd'

Question

我運行TWE模型的源代碼。 我需要編譯python的C擴展。 我已經為Python 2.7和Cython安裝了Microsoft Visual C ++編譯器。

首先，我需要運行TWE / train.py：

import gensim
sentence_word = gensim.models.word2vec.LineSentence("tmp/word.file")
print "Training the word vector..."
w = gensim.models.Word2Vec(sentence_word,size=400, workers=20)
sentence = gensim.models.word2vec.CombinedSentence("tmp/word.file","tmp/topic.file")
print "Training the topic vector..."
w.train_topic(topic_number, sentence)
print "Saving the topic vectors..."
w.save_topic("output/topic_vector.txt")
print "Saving the word vectors..."
w.save_wordvector("output/word_vector.txt")`

二，TWE / gensim / models / wor2vec.py：

try:
    raise ImportError  # ignore for now
    from gensim_addons.models.word2vec_inner import train_sentence_sg,train_sentence_cbow, FAST_VERSION, train_sentence_topic
except ImportError:
    try:
        import pyximport
        print 'import pyximport'
        models_dir = os.path.dirname(__file__) or os.getcwd()
        print 'models_dir'
        pyximport.install(setup_args={"include_dirs": [models_dir, get_include()]})
        print 'pyximport'   # is the follow code's problem
        from word2vec_inner import train_sentence_sg, train_sentence_cbow, 
        FAST_VERSION, train_sentence_topic
        print 'from word2vec'
    except:
        FAST_VERSION = -1
        def train_sentence_sg(model, sentence, alpha, work=None):
                   ...
        def train_sentence_cbow(model, sentence, alpha, work=None, neu1=None):
                   ...
class Word2Vec(utils.SaveLoad):
                   ...
    def train(self, sentences, total_words=None, word_count=0, chunksize=100):
        if FAST_VERSION < 0:
        import warnings
        warnings.warn("Cython compilation failed, training will be slow. Do you have Cython installed? `pip install cython`")
        logger.info("training model with %i workers on %i vocabulary and %i features, "
        "using 'skipgram'=%s 'hierarchical softmax'=%s 'subsample'=%s and 'negative sampling'=%s" %
        (self.workers, len(self.vocab), self.layer1_size, self.sg, self.hs, self.sample, self.negative))
         def worker_train():
              ...
             if self.sg:
                 job_words = sum(train_sentence_topic(self, sentence, alpha, work) for sentence in job)
             else:
                 ob_words = sum(train_sentence_cbow(self, sentence, alpha, work, neu1) for sentence in job)`
              ...

Thrid，我用setup.py編譯了TWE / gensim / models / word2vec_inner.pyx：

from distutils.core import setup  
from distutils.extension import Extension  
from Cython.Build import cythonize  
import numpy  
extensions = [  
    Extension("word2vec_inner", ["word2vec_inner.pyx"],  
              include_dirs=[numpy.get_include()])  
]  
setup(  
    name="word2vec_inner",  
    ext_modules=cythonize(extensions),  
)

通過使用命令'python setup.py install'，我已經編譯了word2vec_inner.pyx。 但它似乎出現以下錯誤：

E:\Python27\python.exe D:/pycharm/TWE/TWE1/train.py wordmap.txt model-final.tassign 100
import pyximport
models_dir
pyximport
word2vec_inner.c
e:\python27\lib\site-packages\numpy\core\include\numpy\npy_1_7_deprecated_api.h(12) : Warning Msg : Using deprecated NumPy API, disable it by #defining NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION
C:\Users\hp\.pyxbld\temp.win32-2.7\Release\pyrex\gensim\models\word2vec_inner.c(15079) : warning C4244:
'initializing' : conversion from 'double' to 'float', possible loss of data
C:\Users\hp\.pyxbld\temp.win32-2.7\Release\pyrex\gensim\models\word2vec_inner.c(15085) : warning C4244 : 'initializing' : conversion from 'double' to 'float', possible loss of data
LINK : fatal error LNK1104: cannot open file 'C:\Users\hp\.pyxbld\lib.win32-2.7\gensim\models\word2vec_inner.pyd'
Training the word vector...
D:\pycharm\TWE\TWE1\gensim\models\word2vec.py:410: UserWarning: Cython compilation failed, training will be slow. Do you have Cython installed? `pip install cython`
warnings.warn("Cython compilation failed, training will be slow. Do you have Cython installed? `pip install cython`")
PROGRESS: at 100.00% words, alpha 0.02500, 2556 words/s
Training the topic vector...
D:\pycharm\TWE\TWE1\gensim\models\word2vec.py:882: UserWarning: Cython compilation failed, training will be slow. Do you have Cython installed? `pip install cython`
warnings.warn("Cython compilation failed, training will be slow. Do you have Cython installed? `pip install cython`")
Exception in thread Thread-23:
Traceback (most recent call last):
  File "E:\Python27\lib\threading.py", line 801, in __bootstrap_inner
      self.run()
  File "E:\Python27\lib\threading.py", line 754, in run
      self.__target(*self.__args, **self.__kwargs)
  File "D:\pycharm\TWE\TWE1\gensim\models\word2vec.py", line 909, in worker_train
     job_words = sum(train_sentence_topic(self, sentence, alpha, work) for sentence in job)
  File "D:\pycharm\TWE\TWE1\gensim\models\word2vec.py", line 909, in <genexpr>
     job_words = sum(train_sentence_topic(self, sentence, alpha, work) for sentence in job)
NameError: global name 'train_sentence_topic' is not defined

Saving the topic vectors...
Saving the word vectors...

Process finished with exit code 0

我已檢查.pyx文件是否已正確編譯並安裝了cython。 總之，它無法從gensim / models / word2vec_inner或gensim_addons / models / word2vec_inner導入train_sentence_sg，train_sentence_cbow，FAST_VERSION，train_sentence_topic。 所以看來這些問題。 但為什么？ 我已經在兩個方向上正確編譯了.pyx文件。 有人可以幫幫我嗎？ 這個問題困擾了我好幾天。 請幫幫我，謝謝！

Answer 1

我遇到了與PyCharm 2018.1 + Python 3.6.2相同的問題。

這條線是關鍵：

LINK : fatal error LNK1104: cannot open file 'C:\Users\hp\.pyxbld\lib.win32-2.7\gensim\models\word2vec_inner.pyd'

此錯誤消息具有誤導性。 使用Python，此錯誤實際上意味着：

• cannot open file to write to it 。

某個進程可能會鎖定該文件以進行寫入，因此鏈接器無法完成其工作。

解決方案1

以前的Python行import word2vec_inner鎖定寫入文件。 重置Python控制台以刪除鎖：

解決方案2

使用Process Explorer找出鎖定文件的程序。 使用Ctrl-F，然后鍵入有問題的鎖定文件的名稱，它將為您提供鎖定文件的進程。

解決方案3

退出Pycharm，然后在命令行上將Cython文件預編譯到一個包中 。 如果此鏈接發生更改，則此處為鏡像：

想象一下hello.pyx文件中的一個簡單的“hello world”腳本：

 def say_hello_to(name): print("Hello %s!" % name) 

以下可能是相應的setup.py腳本：

 from distutils.core import setup from Cython.Build import cythonize setup( name = 'Hello world app', ext_modules = cythonize("hello.pyx"), ) 

要構建，運行python setup.py build_ext --inplace 。 然后只需啟動一個Python會話，然后從hello import say_hello_to執行，並根據需要使用導入的函數。

如果您使用setuptools而不是distutils，則需要注意一點，運行python setup.py install時的默認操作是創建一個壓縮的egg文件，當您嘗試從依賴包中使用它們時，該文件無法與cimport一起使用。 要防止這種情況，請在setup（）的參數中包含zip_safe = False。