| Path : /var/www/html/yedekledb24/DatabaseBackupMaster/__pycache__/ |
|
B-Con CMD Config cPanel C-Rdp D-Log Info Jump Mass Ransom Symlink vHost Zone-H |
| Current File : /var/www/html/yedekledb24/DatabaseBackupMaster/__pycache__/backup_utils.cpython-310.pyc |
o
,��g{� � @ s^ d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl m Z d dl
m Z m Z m
Z
mZ d dlmZmZ d dlmZ e�e�Zd dlmZ d dlmZ dZe�d � z d d
l m Z m Z dZ W n* e y� z d d
l!m Z m Z dZ W n e y� dZ dZ d Z e�"d � Y nw Y nw d
d� Z#dd� Z$ddd�Z%dd� Z&dd� Z'ddd�Z(dS ) � N)�datetime)�DatabaseConnection�
StorageTarget� BackupJob� BackupLog)�upload_to_storage�get_storage_space)�db)� format_size)� perform_incremental_mysql_backupTu\ Artırımlı yedekleme için XtraBackup desteği bulundu. Artırımlı yedekler alınabilir.)� encrypt_file� decrypt_fileFuN GPG şifreleme modülleri yüklenemedi. Şifreleme devre dışı bırakıldı.c
C s� z?| dv rddl }|j|||||dd�}|�� W dS | dkr5ddl}|j|||||dd�}|�� W dS t�d | � �� W d
S tyh } z t�d | � d |� d
|� d|� dt| �� �
� W Y d} ~ d
S d} ~ ww )a�
Test connection to a database server.
Args:
db_type (str): Database type (mysql, mariadb, postgresql)
host (str): Database host
port (int): Database port
username (str): Database username
password (str): Database password
database (str): Database name
Returns:
bool: True if connection successful, False otherwise
��mysql�mariadbr N� )�host�port�user�password�database�connect_timeoutT�
postgresql)r r r r �dbnamer �Unsupported database type: Fz Database connection error for � �:�/�: )�pymysql�connect�close�psycopg2�logger�error� Exception�str)
�db_typer r �usernamer r r �connr" �e� r+ �>/var/www/html/yedekledb24/DatabaseBackupMaster/backup_utils.py�test_database_connection- s@ ��,��r- c
C s� z�t jdd�}|�| j�� � |�� dd| j� �d| j� �d| j� �d| j� �dd d
d d d
dddddd| j d|g}|d }t
j |dd�}t �
|j� |jdkr^t�d|j�� � �� W dS zIt|d��(}ddl}|�|d ��}t�||� W d � n1 s�w Y W d � n1 s�w Y t �|� t�||� t�d � W W dS ty� } zt� d t | �� �� W Y d} ~ W dS d} ~ ww ty� } zt�d t | �� �� W Y d} ~ dS d} ~ ww ) a+
Perform MySQL/MariaDB backup using mysqldump with optimized parameters.
Args:
db_conn (DatabaseConnection): Database connection object
temp_file (str): Path to temporary file for backup
Returns:
bool: True if backup successful, False otherwise
F)�delete� mysqldumpz--host=z--port=z--user=z --password=z--single-transactionz--quickz
--routinesz
--triggersz--eventsz--add-drop-tablez--add-drop-databasez--create-optionsz--extended-insertz
--compressz--max-allowed-packet=1Gz --databasesz-r�.gzT)�capture_outputr zmysqldump error: �rbN�wbz9Compressed MySQL backup file, reducing size significantlyz Could not compress backup file: zMySQL backup error: ) �tempfile�NamedTemporaryFile�writer �encoder! r r r( r �
subprocess�run�os�unlink�name�
returncoder# r$ �stderr�decode�open�gzip�shutil� copyfileobj�remove�move�infor% �warningr& )
�db_conn� temp_file�pwd_file�cmd�compressed_file�result�f_inrA �f_outr* r+ r+ r, �perform_mysql_backup\ sf
�
�� �
� ����rP �scriptc " C s� |dkr t | |�S �z�zddl}d}W n# ty6 zddl}d}W n ty3 t�d� Y Y W dS w Y nw |rJ|j| j| j| j | j
| j dd�}n d | j� d
| j� d | j � d | j � d
| j
� d� }|�|�}|� � }|rr|�
d� n|�
d� dd� |�� D �} t|ddd���}
|
�d| j � d�� |
�dt�� �d�� d�� |
�d| j � d�� | D �]�} t�d | � �� |r�|�
d | � d �� n |�
d | � d �� |�� } d d� | D �}
|
�d | � d!| � d�� |r�|�
d"| � d#�� n |�
d"| � d#�� |�� }|�r|d �r|
�|d � d$�� n=|
�d%| � d&�� t| �D ]*\}\}}|t| �d' k �r:|
�d(|� d)|� d*�� �q |
�d(|� d)|� d+�� �q |
�d,� d-�d.d� |
D ��}|�rg|�
d/|� d0| � d1�� n |�
d/|� d0| � d1�� |�� }|�r.|
�d2| � d3�� d4}tdt|�|�D ]�}|||| � }|
�d5| � d6|� d7�� t|�D ]\}}g }|D ]S}|du �r�|�d8� �q�t|t ��r�|� d9d:�}|�d9|� d9�� �q�t|t��r�|�d9|�d�� d9�� �q�t|t ��r�|�|�r�d;nd<� �q�|�t |�� �q�d-�|�}|t|�d' k�r |
�d=|� d>�� �q�|
�d=|� d?�� �q�|
�d@� �q�|
�d+� q�|
�dA� |�rB|�
dB� n|�
dB� |�� } | D ]@\} } } | �r�|
�dC| � dD| � d+�� |
�dE| � dF�� |
�dG| � dHdI�� dJ| � dK�� |
�dL� |
�| � d+�� |
�dL� �qM|
�dM� W d � n 1 �s�w Y |� � |� � t�dN|� �� W dS t �y� } z t�dOt | �� �� ddl!}!t�|!�"� � W Y d} ~ dS d} ~ ww )Pa�
Perform Microsoft SQL Server backup.
Args:
db_conn (DatabaseConnection): Database connection object
temp_file (str): Path to temporary file for backup
method (str): Backup method: 'script' (Python script extraction) or
'sqlcmd' (direct BACKUP DATABASE command using sqlcmd)
Returns:
bool: True if backup successful, False otherwise
�sqlcmdr NTFz=Neither pymssql nor pyodbc is installed. Cannot backup MSSQL.i )�serverr r r r �timeoutz.DRIVER={ODBC Driver 17 for SQL Server};SERVER=�,z
;DATABASE=z;UID=z;PWD=z;Connection Timeout=1800zPSELECT TABLE_NAME FROM INFORMATION_SCHEMA.TABLES WHERE TABLE_TYPE = 'BASE TABLE'c S � g | ]}|d �qS �r r+ )�.0�tabler+ r+ r, �
<listcomp>� � z(perform_mssql_backup.<locals>.<listcomp>�wzutf-8)�encodingz-- MSSQL Database: z Backup
z -- Generated by yedekleDB24 on z%Y-%m-%d %H:%M:%Sz
zUSE [z];
GO
zBacking up table: zRSELECT COLUMN_NAME, DATA_TYPE FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME = 'z' ORDER BY ORDINAL_POSITIONc S rV rW r+ �rX �colr+ r+ r, rZ � r[ zIF OBJECT_ID('[z#]', 'U') IS NOT NULL
DROP TABLE [z$SELECT OBJECT_DEFINITION(OBJECT_ID('z'))z;
GO
zCREATE TABLE [z] (
� z [z] z,
�
z);
GO
�, c S s g | ]}d |� d��qS )�[�]r+ r^ r+ r+ r, rZ s zSELECT z FROM [rd z-- Inserting data into [z]
i� z
INSERT INTO [z] (z ) VALUES
�NULL�'z''�1�0�(z);
z),
z
GO
z/-- Stored Procedures, Functions, and Triggers
a
SELECT name, type_desc, OBJECT_DEFINITION(object_id) AS definition
FROM sys.objects
WHERE type IN ('P', 'FN', 'TF', 'TR')
AND OBJECTPROPERTY(object_id, 'IsMSShipped') = 0
z-- r zIF OBJECT_ID('z', '') IS NOT NULL
z DROP �_r z [z];
zGO
z!-- Backup completed successfully
z'MSSQL backup completed successfully to zMSSQL backup error: )#�perform_mssql_backup_sqlcmd�pymssql� ImportError�pyodbcr# r$ r r r r( r r �cursor�execute�fetchallr@ r6 r �now�strftimerF �fetchone� enumerate�len�join�range�append�
isinstancer& �replace�boolr! r% � traceback�
format_exc)"rH rI �methodrl � use_pymssqlrn r) �conn_strro �tables�frY �columns� column_names� create_stmt�i�col_name�col_type�cols_str�rows�
batch_size�batch�j�row�values�val� escaped_val�
values_str�objects�obj_name�obj_type�obj_defr* r} r+ r+ r, �perform_mssql_backup� s�
���
�.
� �{��r� c
C s� z�t j�|�}t j|dd� |�d�s t j�|�d d }d| j� d|� d| j� d�}t j�t� � d | j� d
t
t � � �� d ��}t |d ��
}|�
|� W d
� n1 sUw Y g d�}d
}|D ] }t j�|�rn|} nqb|sxt�d� d}|d| j� d| j� �d| jd| jd|dg
} t�d|� �� tj| ddd�}
t j�|�r�t �|� |
jdkr�t�d|
j� �� W dS t�d|� �� W dS ty� } z t�d t | �� �� dd
l } t�| � � � W Y d
} ~ dS d
} ~ ww ) a8
Perform Microsoft SQL Server backup using sqlcmd and native BACKUP DATABASE command.
Args:
db_conn (DatabaseConnection): Database connection object
temp_file (str): Path to temporary file for backup
Returns:
bool: True if backup successful, False otherwise
T��exist_okz.bakr z
BACKUP DATABASE [z]
TO DISK = N'z4'
WITH NOFORMAT, NOINIT,
NAME = N'z@_backup',
SKIP, NOREWIND, NOUNLOAD, STATS = 10
�backup_rj �.sqlr\ N)z/opt/mssql-tools/bin/sqlcmdz/usr/bin/sqlcmdrR z5sqlcmd not found. Please install mssql-tools package.rR z-SrU z-Uz-Pz-iz-bz%Running MSSQL backup using sqlcmd to )r1 �textzsqlcmd error: Fz2MSSQL backup via sqlcmd completed successfully to zMSSQL sqlcmd backup error: ) r: �path�dirname�makedirs�endswith�splitextr rw r4 �
gettempdir�int�timer@ r6 �existsr# r$ r r r( r rF r8 r9 rD r= r> r% r& r} r~ )
rH rI �
backup_dir�backup_command�sql_filer� � sqlcmd_paths� sqlcmd_pathr� rK �processr* r} r+ r+ r, rk i sb
���* � �
�
��rk c
C sL z�t j�� }| j|d< t| j�|d< | j|d< | j|d< | j|d< d}| j rOd| j � d�}t j
� |�rB|}t �
d | j � d
|� �� n
t �d | j � d |� d
�� |dddddddd| g }tj||dd�}|jdkr�|j�� }t �d|� �� d|v r�d|v r�t �d � W d S W dS ty� } zt �d t|�� �� W Y d }~d S d }~ww ) a&
Perform PostgreSQL backup using pg_dump with optimized parameters.
Args:
db_conn (DatabaseConnection): Database connection object
temp_file (str): Path to temporary file for backup
Returns:
bool: True if backup successful, False otherwise
�PGHOST�PGPORT�PGUSER�
PGPASSWORD�
PGDATABASE�pg_dumpz/usr/lib/postgresql/z /bin/pg_dumpzUsing PostgreSQL z specific pg_dump: z PostgreSQL z pg_dump not found at z, falling back to defaultz--format=customz--blobsz--createz--cleanz --if-existsz --verbosez --compress=9z--file=T)�envr1 r zpg_dump error: zserver versionzclient versionz[PostgreSQL version compatibility issue detected. Please set the correct PostgreSQL version.FzPostgreSQL backup error: N)r: �environ�copyr r& r r( r r �
pg_versionr� r� r# rF rG r8 r9 r= r> r? r$ r% ) rH rI r� � pg_dump_cmd�version_specific_cmdrK rM � error_msgr* r+ r+ r, �perform_postgresql_backup� sJ
�
��r� c ,
C s� ddl }t�� }| j}t| jdd�}�z�t�d|� �� tj� | j
�}|spd|� �}t� |� ||_ t
j�|� t
j�� |rmzddlm} ||j� W W d S tyl } zt� dt| �� �� W Y d} ~ W d S d} ~ ww W d S tj� | j�}
|
s�d
|� �}t� |� ||_ t
j�|� t
j�� |r�zddlm} ||j� W W d S ty� } zt� dt| �� �� W Y d} ~ W d S d} ~ ww W d S d} z(t|
�\} }
|
dkr�| |
d nd}|d k r�d
|
j� d|d�d�} t�| � W n t�y
} zdt|�� �} t�| � W Y d}~nd}~ww t �� �d�}|jdv �r5|j � d|� d�}|jdk�r4d|j � d|� d�}n |j � d|� d�}t j � t �!� |�}d }d}t"| d��rX| j#�rX| j#}||_#d}|jdv �r�|dk�r�t$�r�t�d|� d |j� �� |d k�r�tjj%| jd d��&tj'�(� ��)� }|�r�|j}||_*t�d |� d �� n)|d!k�r�tjj%| jdd d"��&tj'�(� ��)� }|�r�|j}||_*t�d#|� d$�� t+||| |�}|�r�|�,dd%�}n�t-||�}n�|jd&k�r�|dk�r�t�|� d'�� d}||_#t.||�}n�|jd(k�r<|dk�rt�|� d)�� d}||_#t"| d*��r/| j/d+k�r/t�d,� t0||d+d-�}n[t�d.� t0||d/d-�}nNd0|j� �}t� |� ||_ t
j�|� t
j�� |�r�zddlm} ||j� W W d S t�y� } zt� dt| �� �� W Y d} ~ W d S d} ~ ww W d S |�s�d1}t� |� ||_ t
j�|� t
j�� |�r�zddlm} ||j� W W d S t�y� } zt� dt| �� �� W Y d} ~ W d S d} ~ ww W d S t j �1|�}d}d2}d }t"| d3��r�| j2�r�zzt j �1|�} t�d4| j3� �� t4j5|| j3d5�}|�rfzt �6|� W n Y |}| j3d6k�r!|d77 }n| j3d8k�r,|d97 }n
| j3d:k�r6|d;7 }t j �1|�} | | | d } d<| d�d=�}d>}| }t�d?t7| �� d@�dAt7| �� dB| d�dC� � W n t�y� } zt� dDt|�� �� dE}W Y d}~nd}~ww d} d2} d }!t8�r6t"| dF��r6| j9�r6z|| j:dGk�r�| j;�r�t<|| j;|dH dI�} dJ} d>}!nF| j:dKk�r�| j=�r�ddLl>m?}" |"j� | j=�}#|#�r�|#j@�r�t<||#j@g|dH dM�} dN|#j� dO�} d>}!nt�dP|� dQ�� n t�dR|� dQ�� | �rzt �6|� W n Y | }|dH7 }t j �1|�}W n t�y5 } zt� dSt|�� �� dT} W Y d}~nd}~ww �zOz�|
jAdUk�r�zbt j �B|�d }$t j �Ct j � dV���s^t jDt j � dV�d>dW� ddlE}%t j � dV|�}&|%�F||&� t�dX|&� �� z t�dY� |&}'W n t�y� }( zt� dZt|(�� �� |&}'W Y d}(~(nd}(~(ww W n) t�y� }) zt� d[t|)�� �� tG|
||�}'W Y d})~)n d})~)ww tG|
||�}'d |_Hg }*|*�Id\� |�r�|*�I|� | �r�|*�I| � | �r�|*�I| � d]� |*�|_ |'|_J||_Kt"|d^��r |!|_L|!�r| j:nd|_:W nl t�yx } z_d_t|�� �}t� |� ||_ t
j�|� t
j�� |�r]z
ddlm} ||j� W n t�y\ } zt� dt| �� �� W Y d} ~ nd} ~ ww W Y d}~W z t �6|� W W d S Y W d S d}~ww W zt �6|� W n Y n
zt �6|� W w Y w t �M� | _Nt�� | }+|+|_Ot
j�|� t
j�� t�d`|� da|+db�dc�� |�r�zddlm} ||j� W W d>S t�y� } zt� dt| �� �� W Y d} ~ W d>S d} ~ ww W d>S t�yM } zRd`|� ddt|�� �}t� |� ||_ t
j�|� t
j�� |�rBz
ddlm} ||j� W n t�yA } zt� dt| �� �� W Y d} ~ nd} ~ ww W Y d}~d S d}~ww )ez�
Run a backup job.
Args:
job (BackupJob): Backup job to run
send_email (bool): Whether to send email notification
Returns:
bool: True if backup successful, False otherwise
r N�failed)�job_id�statuszStarting backup job: z&Database connection not found for job )�send_backup_notificationz#Failed to send email notification: Fz!Storage target not found for job �d �
zWarning: Storage target z has less than 10% free space (z.1fz % remaining)z Could not check storage space: z
%Y%m%d_%H%M%Sr rj r� r �mariadb_z.dump�full�
backup_methodz Performing z backup using XtraBackup for � incremental�successzUsing last backup ID z! as parent for incremental backup� differential)r� r� r� zUsing last full backup ID z" as parent for differential backupz
.xb.tar.gzr zA backup not supported for PostgreSQL, falling back to full backup�mssqlz< backup not supported for MSSQL, falling back to full backup�mssql_backup_methodrR z$Using sqlcmd method for MSSQL backup)r z+Using Python script method for MSSQL backuprQ r zBackup creation failed� �compress_backupz"Applying compression with format: )�compression_type�zipz.ziprA r0 ztar.gzz.tar.gzu (Sıkıştırma: z%)Tz"Compression successful. Original: rb z Compressed: z , Ratio: �%zFailed to compress backup: u (Sıkıştırma BAŞARISIZ)�encrypt_backup� symmetricz.gpg)�
passphrase� output_fileu" (GPG ile şifrelenmiş, simetrik)�
asymmetric)�
EncryptionKey)�
recipientsr� u" (GPG ile şifrelenmiş, anahtar: �)z!Encryption key not found for job z, skipping encryptionz)Invalid encryption configuration for job zFailed to encrypt backup: u0 (Şifreleme BAŞARISIZ - şifrelenmemiş yedek)�ftp�database_backupsr� zSaved local backup copy to uF FTP yükleme işlemi atlanıyor (potansiyel zaman aşımı sorunları)zThreaded FTP upload error: zLocal backup error: z Backup completed successfullyz. � encryptedzFailed to upload backup: z Backup job z completed successfully in z.2fz secondsz failed: )Pr r� r< r �idr# rF r �query�get� database_idr$ �messager �session�add�commit� email_utilsr� r% r& r �
storage_idr rG rr rs r' r r: r� rw r4 r� �hasattrr� �incremental_backup_support� filter_by�order_by� timestamp�desc�first�
parent_log_idr r{ rP r� r� r� �getsizer� r� �database_compression�
compress_filerD r
�encryption_supportr� �encryption_type�encryption_passphraser �encryption_key_id�modelsr� �email� storage_typer� r� r� rB �copy2r r� ry � backup_file� backup_sizer� �utcnow�last_run�duration),�job�
send_email�dt�
start_time�job_name�
backup_logrH �msgr� � email_err�storage�storage_warning�
free_space� total_space� percent_freer* r� �backup_filenamerI �backup_successr� r� � last_backup�last_full_backupr� rL �compression_message�
compressed�
original_size�compressed_size�compression_ratio�encrypted_file�encryption_messager� r� �key�backup_filename_no_extrB �local_backup_path� remote_path�
thread_err� local_err�
message_partsr� r+ r+ r, �
run_backup� s�
� ��
� ��
��� �
���
�� �
� ��
� �� �
����� � ���
�����
�
�� ����
� ��
����r )rQ )T))r: r� r8 r4 �loggingr� rB rA � threadingr r� r r r r �
storage_utilsr r �appr � getLogger�__name__r# �utilsr
r r� rF �encryption_utils_simplifiedr r
r� rm �encryption_utilsrG r- rP r� rk r� r r+ r+ r+ r, �<module> sP
��� /
I ERB