php - ElasticSearch query hangs in laravel job queue -


i using laravel-elasticsearch provider es queries. using within job processed laravel queue(using beanstalkd). problem having in long running jobs, no longer able insert data elasticsearch. job hangs (no exceptions thrown) have narrowed down code making es call. possible connection become stale how , not reconnect? other thought has using facade , being singleton.

here doing, not exact code. code works fine when not run in long running job.i wanted provide context.it inserts fine, there no issues code functioning until run after long running process.

update:

i have narrowed issue down elasticsearch-php library persisting connection. have es behind load balancer times out tcp connections after 5 min. issue there no keep alive in es php library. after 5 min connection closed not close connection on end. there way set keep alive elasticsearch-php? or call reset connection?

//run functions.... $params = array(); $params['body']  = array('somefield' => 'some data'); $params['index'] = 'my_index'; $params['type']  = 'my_type'; $params['id']    = 'my_id'; $ret = es::update($params);//this working fine  //long running function here $newparams = array(); $newparams['body']  = array('somefield' => 'some data'); $newparams['index'] = 'my_index'; $newparams['type']  = 'my_type'; $newparams['id']    = 'my_id'; $return = es::update($newparams);//this hang

gather around, , let's talk long lasting queue processes.

laravel queues work, workers. rentless elves fetch jobs our queue service , processes them in timely fashion.

however, after long periods of incessant work, our elves start tired , create errors randomly. types of errors include failure to send mail using swiftmailer, process database transactions or connect ssl ports.

what our elves need, energy drink, in form of queue:restart, every 20 mins.

steps implement:

1) if on linux, type in console sudo crontab -e

2) using vim, enter following lines 0,20,40 * * * * cd /path/to/my/laravel/installation && php artisan queue:restart --env=yourenvironment 1>> /dev/null 2>&1

replace /path/to/my/laravel/installation laravel's path.

and yourenvironment laravel's environment name.

source: have elasticsearch installation uptime of 1 month, , laravel polling , updating data in real-time using shift31's package.

documentation: http://laravel.com/docs/5.0/queues#daemon-queue-worker


-

Popular posts from this blog

c# - ODP.NET Oracle.ManagedDataAccess causes ORA-12537 network session end of file -

overview i want replace oracle.dataaccess orcale. managed dataaccess, opening connection latter throws ora-12537 network session end of file exception. exception message / stack trace {oracleinternal.network.networkexception (0x000030f9): ora-12537 : netzwerksession: dateiende @ oracleinternal.network.readerstream.read(orabuf ob) @ oracleinternal.ttc.orabufreader.getdatafromnetwork() @ oracleinternal.ttc.orabufreader.read(boolean bignoredata) @ oracleinternal.ttc.marshallingengine.unmarshalub1(boolean bignoredata) @ oracleinternal.ttc.ttcprotocolnegotiation.readresponse()} i trying connect oracle 11g database , not have client installed on local machine. working test application (unmanaged) using oracle.dataaccess works fine . using system; using oracle.dataaccess.client; namespace app.odp.unmanaged { internal class program { private static void main(string[] args) { //dummy connection string...
Read more

matlab - Compression and Decompression of ECG Signal using HUFFMAN ALGORITHM -

i want compress , decompress ecg signal stored text message text file , find out file size, cr,prd ratio,and qs. here code compression , decompression of ecg signal using huffman algorithm. i'm trying find out file size, compression ratio,prd ratio,qs. but error i'm getting the ecg file in text format. %clearing variables , screen enter code here clear all; close all; clc; [file1]=uigetfile('*.txt'); %fprintf('enter ecg file name :%s',file1); p=file1; t=sprintf('%s',p); b1=dlmread([file1]); len=length(b1); lead=input('enter lead number :'); %lead=str2double(lead); col2=b1(1:end,lead); e=fix(sqrt(len)); m=1; i=1:e j=1:e g2(i,j)=fix(col2(m)*1000); %amplifying 1000 m=m+1; end end g3=g2; i=1:e j=1:e ...
Read more

utf 8 - split utf-8 string into bytes in python -

i trying split utf-8 string bytes in python 3. problem is, when use bytearray, byte, encode etc functions array size of element 14 bytes, not 1 byte expected. need split text file sequence of bytes , send them byte after byte using sockets. tried this: infile = open (file, "r") str = infile.read() byte_str = bytes(str, 'utf-8') print("size of byte_str",sys.getsizeof(byte_str[0])) print gives me 14, need 1... suggestion? quoting official documentation : sys.getsizeof(object[, default]) return size of object in bytes. object can type of object. built-in objects return correct results, not have hold true third-party extensions implementation specific. only memory consumption directly attributed object accounted for, not memory consumption of objects refers to. if given, default returned if object not provide means retrieve size. otherwise typeerror raised. getsizeof() calls object’s __sizeof__ method , adds ...
Read more