Download as pdf or txt
Download as pdf or txt
You are on page 1of 3

PrepareTransferData_Model2

PrepareTransferData
15Jan - 21Jan

CraftScript (1-2 day) (1-2 คน)


แยกแฟ้มละไฟล์, ปิดเวลาเดียวกัน ตีหนึ่ง

Test Script Export Mysql #ake


Test Import to file.sql to PG (mini table) #aun
Check Free Storage All Old HDC #aun
Remove Large File in Old HDC #aun

Setting Script Job (1 day) (1คน) #aun

Setting script.sh & cronjob setting


Craft script Export 51 table to /tmp/hdc_{table}.sql
Loop put Script dump43file.sh to HDCOld /var/dump43file.sh
Loop set CronJob Export

echo "1 19 * * * /bin/sh /var/dump43file.sh" | tee -a


/var/spool/cron/root

TransferData.sql (16jan-21jan) (1-2คน)

Transfer SCP /tmp/hdc{table}.sql file จาก ServerHDCOld ไปเก็บที่


ServerDBPG_HDC_ECO ของแต่ละจังหวัด /var/hdc{table}.sql #tan
day1 _ 13 province /var/eaktmp/loopcmd/day1.txt
day2_ 10 province /var/eaktmp/loopcmd/day2.txt
Check File Hashing ตรงกัน 2 ฝั่ง จากนั้น ลบ .sql ใน Old_HDC #tan

Import to PG
(16jan-21jan) (แฟ้ม/คน) #serm #beer #gun #peem #aun #tan

Create Table 43 Structure ใน DB PG_HDC_ECO 77prov #aun


Craft Script Formatting .sql for Import RegEx #aun #tan

sed -i "s/'0000-00-00'/NULL/g" hdc_provider.sql


sed -i 's/`//g' hdc_provider.sql
sed -i "s/'0000-00-00 00:00:00'/NULL/g" hdc_provider.sql

Import Data to PG > เก็บ .log find ERROR

แจก Server IP "ipserver_final.xlsx", Username Pass SSH #tan


ตั้ง gSheet command Fix Import Error #aun
Import Data run in Server PG HDC_ECO (9table/worker)
#serm
,village,prenatal,postnatal,surveillance,admission,investigation_ref
er,appointment,specialpp,charge_opd
#aun
,disability,newborncare,anc,accident,chronic,address,procedure_o
pd,diagnosis_opd
#beer
,care_refer,labor,functional,procedure_refer,community_service,ep
i,nutrition,drug_opd
#gun
,community_activity,icf,refer_result,women,rehabilitation,ncdscree
n,person,labfu
#peem
,refer_history,newborn,drugallergy,home,procedure_ipd,diagnosis
_ipd,card,charge_ipd
#tan
,clinical_refer,provider,death,fp,drug_refer,dental,chronicfu,drug_ip
d,service
Run

cat hdc_{table}.sql | grep INSERT | wc -l

sudo -u postgres psql -d hdc -a -f hdc_{table}.sql >


/var/hdc_{table}.log

cat hdc_{table}.log | grep error > hdc_{table}_error.log

Fix Error More จาก .log , Script Formatting .sql for Import RegEx
Truncate ก่อน Re Run
Run Import again
First Priority นครราชสีมา > Second Priority นนทบุรี > all Province

You might also like